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Overview 


In  April  2001 ,  the  General  Accounting  Office  released  the  results  of  a  large-scale  study 
addressing  the  consistent  use  of  guidelines  and  appropriateness  of  quality  control  in  Department  of 
Defense  (DOD)  Personnel  Security  adjudication  facilities.  Such  facilities  evaluate  all  information 
provided  by  Personnel  Security  Investigators  as  to  the  suitability  of  DOD  employees  for  security 
clearances.  These  decisions  are  made  based  on  established  guidelines  for  what  behaviors  or  past 
information  might  disqualify  an  individual  from  consideration  for  clearance  as  well  as  factors  that  might 
mitigate  such  disqualifying  information.  GAO’s  study  reported  both  a  lack  of  consistent  application  of 
established  adjudicative  guidelines  as  well  as  a  need  for  stronger  quality  control  within  individual  DOD 
central  adjudication  facilities  (CAFs). 

The  need  for  consistent  application  of  the  adjudicative  guidelines  and  more  quality  control  are 
important  when  considering  the  reciprocity  of  adjudicative  decisions  between  agencies.  If  clearance 
decisions  are  consistent  with  guidelines  and  evaluated  for  quality  in  the  same  manner  in  all  agencies,  it  is 
less  difficult  to  transfer  security  clearances  between  agencies.  Although  a  single  centralized  adjudication 
facility  has  been  proposed  that  might  solve  some  of  these  problems,  individual  CAFs  reject  this  notion, 
stating  that  they  each  have  unique  functions  and  problems  that  could  not  be  address  within  a  centralized 
facility  (GAO,  2001). 

Currently,  however,  the  situation  remains  that  individual  CAFs  do  appear  to  apply  the 
adjudicative  guidelines  differently  and  that  they  do  not  have  a  uniform  standard  for  assessing  quality  of 
adjudicative  decisions. 

In  addition  to  consistency  and  quality  concerns,  DOD  is  also  dealing  with  a  large  backlog  of 
reinvestigations  that  have  not  been  performed  in  addition  to  normal  requests  for  new  investigations  and 
clearance  decisions.  GAO  (2000)  estimated  a  backlog  of  over  550,000  reinvestigations,  which  has  grown 
despite  efforts  to  sustain  it.  Although  the  investigative  portion  of  the  clearance  process  can  be  handled 
somewhat  through  contracted  investigators,  adjudications  must  be  handled  through  their  respective 
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agencies  directly.  Thus,  the  large  backlog  of  investigations  also  creates  a  backlog  of  adjudications,  which 
creates  large  workloads  for  adjudicators.  This  heavy  workload  then  increases  the  need  for  decisions  to  be 
made  in  a  timely  manner. 

In  accordance  with  the  needs  expressed  by  GAO  (2001),  this  study  is  expected  to  contribute  to 
the  understanding  of  these  problems  by  examining  how  various  organizational  and  situational  factors 
influence  personnel  security  adjudications.  Specifically,  this  study  will  focus  on  how  certain 
organizational  factors  (judgment  intent  and  quality  evaluation  procedures)  and  situational  factors  (risk — 
as  determined  by  level  of  clearance — and  workload)  influence  the  consistency,  accuracy,  timeliness,  and 
quality  of  clearance  decisions.  Moreover,  this  research  is  expected  to  provide  implications  for  the  notions 
of  reciprocity  and  centralization  of  adjudications. 

Five  specific  questions  were  addressed  in  this  study:  1)  How  do  organizational  factors, 
specifically  judgment  intent  and  evaluation  expectation,  influence  consistent  use  of  decision  rules,  overall 
accuracy  and  quality  of  decisions,  and  timeliness  with  which  decisions  are  made  across  CAFs?  2)  How  do 
risk,  or  security  level  of  case,  and  workload  influence  consistent  use  of  decision  rules,  overall  accuracy 
and  quality  of  decisions,  and  timeliness  with  which  decisions  are  made  within  a  CAF?  3)  Which 
organizational  and  situational  factors  appear  to  exert  the  most  influence  on  consistency  with  the 
adjudicative  guidelines?  4)  How  does  the  expectation  of  evaluation  influence  quality  of  security 
clearance  decisions?  5)  How  can  organizational  and  situational  factors  influence  decision  reciprocity? 
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Abstract 

The  decisions  that  managers  make  can  be  influenced  by  a  number  of  factors.  The  current  study 
examines  two  specific  organizational  factors  (judgment  intent  and  evaluation  expectancy)  and  two  task 
demand  characteristics  (situational  risk  and  workload)  that  might  influence  the  consistency,  accuracy, 
timeliness,  and  quality  of  adjudicative  decisions.  Analysis  of  Variance  (ANOVA)  and  Analysis  of 
Covariance  (ANCOVA)  results  reveal  that  these  factors  do  have  significant  influences  on  various  aspects 
of  adjudicative  decisions.  Most  notably,  the  expectation  of  evaluation  was  revealed  to  both  help  and 
hinder  decision-making,  dependent  on  other  contextual  factors  and  situational  risk  consistently  led  to 
better  decisions.  Additionally,  implied  risk  almost  always  led  to  more  consistent,  more  accurate,  more 
timely,  and  high  quality  decisions.  Implications  are  presented  for  addressing  these  factors  and  helping 
managers  make  the  best  decisions  under  certain  organizational  and  situational  constraints. 
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Intent  of  Study 

Each  day  human  resource  (HR)  decision  makers  use  personnel  records  and  case-files  to  make 
hiring  and  promotion  decisions.  These  records  provide  an  abundance  of  information  that  evaluators 
organize  and  synthesize  in  order  to  make  a  judgment  regarding  an  individual’s  suitability  for  a  given  work 
assignment  (Gardner,  1977).  For  many  years  case-file  reviews  have  been  used  to  make  personnel 
decisions  in  a  number  of  domains  including,  but  not  limited  to,  management  (Ash,  et.  al.,  1989;  Brown, 
1991;  Hanson  &  Balestreri-Spero,  1985;  Lowry,  1994),  education  (Goodman,  1990;  Hanlon,  1964; 
Salthouse,  et.  al.,  1978;  Sangren,  1935;  Twombly,  1992),  and  government  (Ash,  et.al.,  1989;  Lowry, 

1994;  Sproule  &  Berkley,  2001). 

In  industrial  settings,  managers  use  records  and  case-files  to  make  a  number  of  different 
personnel  decisions.  Prospective  employees  are  screened  based  on  information  provided  in  job 
applications  and  resumes  (Ash,  et.  al,  1989;  Hanson,  1985).  Promotion  decisions  are  often  based  on  past 
performance  and  productivity  records  (Lowiy,  1994).  Finally,  records  examining  past  performance  and 
prior  work  behavior  sometimes  provide  the  basis  for  downsizing  or  termination  decisions  (Jordan  & 

Nasis,  1992;  Martin,  Bartol,  &  Kehoe,  2000.) 

In  educational  settings,  case-file  information  in  fact  plays  a  central  role  in  many  key  personnel 
decisions.  Admission  to  professional  or  graduate  schools  is  traditionally  based  on  a  collective  file 
containing  academic  transcript  records,  resumes,  and  other  documentation,  such  as  letters  of 
recommendation,  regarding  a  prospective  student’s  potential  for  success(Hanlon,  1964).  Tenure  decisions 
for  professorial  positions  are  routinely  made  based  on  curriculum  vitas  and  performance  records 
(Goodman,  1990).  Moreover,  search  committees  for  both  new  professors  and  new  administrators  (i.e., 
provosts,  deans,  and  presidents)  often  rely  on  case-files  as  the  sole  basis  for  initial  screening  of  applicants 
(Twombly,  1992). 

Ash  and  colleagues  (1989)  note  that  case-file  reviews  are  used  for  applicant  screening  in  virtually 
all  areas  of  the  public  sector  and  government.  One  particular  area  of  the  public  sector  in  which  the  use  of 
personnel  records  for  personnel  decision-making  has  been  advocated  is  police  officer  screening  and 
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selection  (Sproule  &  Berkley,  2001;  Thornton  &  Morris,  2001).  In  the  U.S.  Government  and  DOD, 
personnel  security  is  another  area  in  which  personnel  decisions  are  made  based  primarily  on  background 
information  presented  in  security  case-files. 

Case-based  Decisions 

There  are  several  advantages  to  using  case-file  information  in  personnel  decision-making.  First, 
compared  to  other  selection  tools,  development  and  implementation  costs,  both  financially  and  in  amount 
of  time  spent,  of  using  case-files  are  relatively  low  (Ash,  et.  al.,  1989;  Hinrichs,  1969).  Next,  the  amount 
of  effort  expended  on  the  part  of  both  managers  who  make  selection  decisions  and  job  candidates  is 
considerably  less  than  most  paper-and-pencil  testing  systems  or  assessment  centers  (Ash,  et.  al.,  1989). 
Finally,  several  studies  have  found  that  case-file  information  is  a  good  predictor  of  future  work 
performance  when  interpersonal  factors  are  not  important  (Brown,  1991;  Hinrichs,  1969;  Lowry,  1994). 

There  are  also  two  major  disadvantages  to  using  case-file  information  in  personnel  decision¬ 
making.  The  most  noted  disadvantage  is  that  the  quality  of  case-file  information  is  not  consistently  high. 
Several  studies  have  shown  that  case-files  are  often  unstructured  (Ash,  et.  al.  1989),  out-of-date  (Lowiy, 
1994),  missing  significant  pieces  of  information  (Thornton  &  Morris,  2001),  or  containing  inaccurate 
information  (Brown,  1991).  Even  if  all  provided  records  are  near  perfect  and  highly  accurate,  a  second 
disadvantage  leads  to  some  difficulty  in  using  case-files  as  the  basis  for  personnel  decisions.  Specifically, 
such  decisions  are  the  evaluator’s  personal  professional  judgment  and  may  be  subject  to  the  idiosyncratic 
biases  of  the  evaluator  (Gardner,  1977).  Obvious  biases  may  include  gender,  race,  and  age  biases,  all  of 
which  could  pose  serious  legal  consequences  should  decisions  statistically  reflect  a  significant  amount  of 
bias.  Less  obvious  biases  may  arise  when  personal  information  not  related  to  the  job  in  question  arouses 
underlying  prejudices  of  which  the  evaluator  may  not  be  aware  (Hinrichs,  1969;  Lowry,  1994).  For 
example,  the  evaluator’s  opinions  of  an  applicant’s  previous  employer  might  inadvertently,  and 
inappropriately,  influence  a  selection  decision  and  consequently  bias  the  entire  selection  procedure. 

Evaluators’  biases  might  also  be  based  on  organizational  and  situational  pressures  they  are  facing. 
At  the  organizational  level,  political  influences,  such  as  a  supervisor’s  desires,  or  social  influences,  such 
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as  norms  and  expectations  of  the  type  of  person  who  “fits”  the  organization,  are  likely  to  sway  evaluators’ 
judgments  (Twombly,  1992).  Situational  pressures,  such  as  having  fewer  applicants  than  available 
positions  or  having  a  limited  amount  of  time  to  evaluate  job  candidates,  may  also  constrain  judgment 
(Sangren,  1935).  Unfortunately,  these  types  of  organizational  and  situational  influences  on  case-file-based 
decisions  have  not  been  widely  addressed  in  the  personnel  decision-making  literature. 

Many  studies  have  examined  the  use  of  personnel  records  and  case-files  in  HR  decision-making. 
These  studies  have  looked  at  1)  the  ways  in  which  recorded  information  is  used  to  make  HR  decisions 
(Ash,  et.  al.,  1989),  2)  the  problems  with  using  personnel  records  in  HR  decisions  (Gardner,  1977;  Lowry, 
1994),  and  3)  the  practicality  of  using  case-file  information  to  make  personnel  decisions  (Hinrichs,  1969; 
Lowry,  1994;  Salthouse,  McKeachie,  &  Lin,  1978;  Thornton  &  Morris,  2001).  Few,  if  any,  of  these 
studies,  however,  have  examined  the  consistency,  accuracy,  and  quality  of  HR  decisions  based  on  case- 
file  information.  Thus,  the  intent  of  the  current  study  is  to  examine  the  consistency,  accuracy, 
timeliness,  and  quality  of  personnel  decisions  that  are  based  on  case-file  information  in  one 
particular  domain — government  personnel  security. 

Personnel  Security  Adjudications 

In  the  U.S.  government  and  DOD,  security  clearance  decisions  ultimately  determine  what  jobs  an 
individual  is  eligible  to  be  placed  in.  Thus,  many  government  and  military  employees  must  undergo 
security  evaluations  in  which  a  security  clearance  is  granted  based  on  an  in-depth  evaluation  of  security 
records.  Security  clearance  decisions  initially  entail  a  detailed  investigation  of  the  individual  and  a 
compilation  of  security  records,  or  cases,  based  on  the  results  of  the  investigation.  These  cases  are  then 
submitted  to  one  of  several  personnel  security  CAFs,  or  CAFs,  in  which  individual  adjudicators 
ultimately  decide  if  an  individual  is  eligible  for  access  to  secure  information. 

Adjudicators  evaluate  all  information  provided  by  personnel  security  investigators  as  to  the 
suitability  of  government  and  military  employees  for  security  clearances.  These  decisions  are  based  on 
established  guidelines  bearing  on  the  behaviors  or  past  information  that  might  disqualify  an  individual 
from  consideration  for  clearance  as  well  as  factors  that  might  mitigate  any  disqualifying  information.  In 
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2001,  the  General  Accounting  Office  (GAO)  released  the  results  of  a  large-scale  study  addressing  the 
consistent  use  of  the  guidelines  and  appropriateness  of  quality  control  in  individual  CAFs.  This  study 
reported  both  a  lack  of  consistent  application  of  established  adjudicative  guidelines  as  well  as  a  need  for 
stronger  quality  control  within  individual  CAFs  and  for  faster,  or  more  timely,  decisions  in  order  to  keep 
up  with  current  workloads. 

Influences  on  Personnel  Security  Adjudications 

The  consistency,  accuracy,  timeliness,  and  quality  of  adjudication  decisions  may,  like  many  other 
decisions,  be  influenced  by  both  the  organizational  variables  shaping  decision-making  practices  and 
processes  and  by  characteristics  of  the  decision  task.  Kida  ( 1 982)  states  that  the  norms  and  expectations 
of  a  social  organization  can  influence  an  individual’s  behavioral  intentions  and  judgments.  This 
hypothesis  sheds  some  initial  light  on  why  individual  decision  makers  in  different  agencies  are  likely  to 
make  inconsistent  decisions  when  given  similar  types  of  information. 

Organizational.  Influences.  In  the  federal  government,  individuals  must  meet  specific 
requirements  to  obtain  any  level  of  security  clearance.  Individuals  may  be  disqualified  for  a  number  of 
reasons,  while  such  disqualifying  information  may  be  mitigated  in  numerous  ways.  Unfortunately,  it  is 
not  specified  how  individual  CAFs  are  to  apply  these  disqualifying  and  mitigating  factors.  Specifically, 
some  CAFs  have  adopted  an  organizational  policy  to  help  individuals  who,  initially,  are  not  qualified  for 
clearance  to  take  some  rehabilitative  action  that  will  mitigate  those  factors  and  help  them  establish 
clearance  eligibility.  Examples  might  be  providing  credit  counseling  to  an  individual  who  has  poor  credit 
history  or  recommending  an  alcohol  treatment  center  to  someone  with  a  drinking  problem.  Other  CAFs, 
on  the  other  hand,  may  simply  examine  the  available  disqualifying  and  mitigating  information  that  is 
currently  available  and  make  a  judgment.  This  is  what  we  have  termed  judgment  intent.  It  is  the 
overarching  intention  that  is  present  within  the  CAF  to  develop  an  individual  to  be  “clearable”  or  not. 

Judgment  intent  is  held  to  influence  the  judgment  processes  of  individual  decision-makers.  When 
an  individual  has  a  preliminary  intent,  or  desired  end-state,  for  a  judgment,  he  or  she  is  likely  to  bias 
information  processing  in  favor  of  that  intent  (Russo,  Medvec,  &  Meloy,  1996;  Shafir,  1993;  Shafir  & 
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Tversky,  1992).  The  decision-maker  is  likely  to  frame  the  problem  (the  case)  in  terms  of  organizational 
norms  (Tversky  &  Kahneman,  1988).  Thus,  if  the  CAF  norm  is  to  rehabilitate  and  an  adjudicator  believes 
an  individual  can  be  rehabilitated  based  on  available  information,  the  adjudicator  is  likely  to  provide 
developmental  opportunities  to  the  individual  before  ruling  him  or  her  not  eligible  for  security  clearance 
(Svenson,  1999).  When  such  an  expectation  does  not  exist,  however,  this  processing  bias  does  not  seem 
to  occur  (Russo,  Medvec  &Meloy,  1 996).  With  respect  to  the  effect  that  judgment  intent  can  have  on 
decision-making,  our  first  two  hypotheses  are  as  follows: 

Hypothesis  1:  When  a  developmental  judgment  intent  is  present  in  an  adjudication  agency, 
consistency  and  accuracy  of  security  decisions  will  be  less  than  when  a  developmental  intent  does 
not  exist; 

Hypothesis  2:  When  a  developmental  judgment  intent  is  present  in  an  adjudication  agency, 
decision  timeliness  and  quality  will  be  the  same  as  when  a  developmental  intent  does  not  exist. 

A  second  norm  that  might  influence  how  security  case-file  information  is  processed  is  the 
expectation  of  evaluation.  Currently,  individual  CAFs  do  not  have  standard  quality  assurance  and 
evaluation  programs  (GAO,  2001).  Although  some  agencies  report  internal  quality  control,  evaluations 
systems  are  not  standard  across  all  facilities.  Because  the  organizational  context  is  expected  to  influence 
how  decision  rules  are  applied  (Svenson,  1999),  it  makes  sense  that  the  expectation  of  having  their 
decisions  evaluated  by  another  might  influence  how  adjudicators  use  available  information.  Tversky  and 
Kahneman  (1988)  report  that  the  expectancies  of  the  decision-maker  do,  in  fact,  influence  the  way  in 
which  a  decision  is  framed  and  how  information  is  used  to  make  that  decision.  Specifically,  Bell  (1982), 
describes  the  nature  of  individuals  to  react  to  possible  evaluation  of  decisions.  Individuals  hope  to  avoid 
negative  evaluations  (making  a  bad  decision)  in  order  to  avoid  feelings  of  regret.  Expectations  of 
evaluation  and  feedback  often  create  the  possibility  for  regret  and  subsequently  influence  decision¬ 
making  processes  (Josephs,  Larrick,  Steele  &  Nisbett,  1992;  Larrick,  1993;  Tindale,  1989).  Therefore, 
when  individual  adjudicators  in  a  CAF  expect  that  their  decisions  will  be  evaluated,  they  may  take  more 
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time  to  make  decisions,  potentially  using  case  information  differently  than  those  adjudicators  in  agencies 
where  evaluation  is  not  expected.  Based  on  these  observations,  hypothesis  three  is  as  follows: 

Hypothesis  3:  A  high  expectation  of  evaluation  within  an  adjudication  agency  will  lead  to 
greater  consistency,  accuracy,  and  quality  and  less  timeliness  of  security  decisions  than  a  low 
expectation  of  evaluation. 

Task  Demands.  Decision  risk  is  defined  by  the  level  of  confidentiality  which  a  security  clearance 
under  consideration  is  linked  to.  Typically,  in  CAFs,  junior  adjudicators  are  more  likely  to  decide  lower 
security  cases  (confidential  or  secret),  while  senior  adjudicators  decide  high  security  cases  (top  secret). 
This  level  of  clearance  implies  certain  levels  of  risk  if  a  clearance  is  granted  to  an  individual  who  is  a 
threat  to  national  security.  Although  an  individual  with  a  confidential  security  badge  is  privilege  to  some 
sensitive  information,  an  individual  with  a  top-secret  badge  is  often  privilege  to  the  most  secret 
information  the  government  maintains.  Thus,  top-secret  clearances  pose  greater  risks  to  adjudicators;  if 
they  make  a  bad  decision,  the  consequences  could  pose  a  severe  threat  to  national  security.  Individuals 
will  tend  to  avoid  risky  decisions  when  possible  (Larrick,  1993;  Tversky  &  Kahneman,  1988),  but  when 
avoidance  is  impossible,  they  will  try  to  avoid  making  a  poor  decision  in  order  to  avoid  emotional 
feelings  of  regret  (Bell,  1982;  Larrick,  1993).  One  would  assume,  then,  that  adjudicators  making  high- 
level  clearance  decisions  would  pay  closer  attention  to  available  information  and  use  more  available 
information  than  those  making  lower-level  decisions.  Therefore,  we  propose  hypotheses  four: 

Hypothesis  4:  Individuals  who  perceive  a  high  level  of  risk  involved  in  their  decisions  will  make 
more  consistent,  accurate,  and  high  quality  and  less  timely  security  decisions  than  when 
perceived  risk  is  low. 

Finally,  workloads  may  vary  for  adjudicators  within  a  given  CAF.  Specifically,  junior 
adjudicators  are  often  assigned  to  make  preliminary  decisions  on  many  cases  and  pass  them  on  to  a 
supervisor  for  review.  As  noted  earlier,  supervisors,  or  senior  adjudicators,  are  also  assigned  to  high- 
security  cases.  Workload  for  senior  adjudicators  is  heavy  based  on  regular  workload  of  high-security 
cases,  review  and  decision  of  preliminary  decisions  made  by  junior  adjudicators.  In  addition,  workloads 
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for  all  adjudicators  are  currently  very  high  because  of  a  long-term  and  growing  backlog  of  new 
investigations  and  reinvestigations  (GAO,  2001). 

Heavy  workload,  however,  often  leads  to  less  cognitive  processing  of  all  available  information 
and  to  a  search  for  the  most  salient  or  specific  information  relative  to  the  decision  (Ordonez  &  Benson, 
1997;  Wright,  1974).  Additionally,  heavy  workload  is  believed  to  contribute  to  greater  decision  stress 
(Lee  &  Ashforth,  1996),  which  has  been  shown  to  cause  impulsive  and  disorganized  decision-making 
(Janis  &  Mann,  1977).  Such  decisions,  relative  to  decisions  made  without  stress,  are  believed  to  be 
deficient  because  they  are  based  on  selective  information  usage,  a  consideration  of  only  limited  outcomes, 
a  rapid  evaluation  of  information,  and  a  final  decision  that  lacks  extensive  appraisal  of  all  information 
(Janis  &  Mann,  1977;  Johnston,  Driskell  &  Salas,  1997).  In  light  of  these  findings,  we  propose  a  fifth 
hypothesis: 

Hypothesis  5:  In  high  workload  situations,  security  decisions  will  be  less  consistent,  less 

accurate,  more  timely,  and  of  lower  quality  than  decisions  made  in  low  workload  situations. 

Methods 

Participants 

A  total  of  240  participants  from  a  large  Southwestern  university  completed  this  study.  Sixty-eight 
percent  of  the  participants  were  female  and  32%  were  male.  Participants  ranged  in  age  from  1 7  to  29 
years,  with  an  average  age  of  19  years.  Almost  seventy-two  percent  of  participants  were  freshman  in 
college,  while  17%,  6%,  and  6%  were  sophomores,  juniors,  or  seniors,  respectively.  Additionally,  34%  of 
participants  reported  that  they  were  working  in  a  full-  or  part-time  job  at  the  time  of  the  study,  while  1 0% 
of  participants  reported  past  managerial  experience. 

General  Procedure 

In  eight  sessions  composed  of  30  individuals  per  session,  participants  completed  this  study  to 
partially  fulfill  experimental  requirements  for  an  introductory  psychology  course.  Because  this  study  was 
carried  out  in  a  university  setting,  it  evaluated  similar  clearance-type  decisions  as  they  might  be  made  in 
industiy.  It  was  neither  feasible  nor  wise  to  present  individuals  in  a  university  setting  with  personnel 
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security-type  files  and  introduce  them  to  the  manner  in  which  security  decisions  are  made  within  the 
government.  Accordingly,  participants  in  this  study  were  recruited  for  a  two-part  business  decision¬ 
making  study  that  lasted  a  total  of  three  hours. 

During  part  one,  each  participant  completed  a  short  set  of  psychometric  measures.  The  general 
strategy  involved  in  part  two  of  this  study,  the  adjudication  task,  was  to  encourage  participants  to  take  on 
the  role  of  a  security  manager  in  large  oil  and  gas  company  where  they  would  make  personnel  security 
decisions  by  evaluating  employee  case-files.  Each  participant  read  a  group  of  company  documents  and 
completed  a  practice  evaluation  in  order  to  prepare  them  for  the  actual  decision-making  task. 

Covariate  Measures 

Part  one  of  this  study  took  approximately  one-half  hour.  During  this  phase  of  the  study, 
participants  were  asked  to  complete  a  battery  of  psychometric  covariate  measures  including  a  background 
information  sheet,  the  Need  for  Cognition  Scale  (NCS;  Cacioppo  &  Petty,  1982),  a  Cognitive  Flexibility 
Scale  (Martin  &  Rubin,  1995),  and  the  Verbal  Reasoning  scale  from  the  Employee  Aptitude  Survey 
(Ruch  &  Ruch,  1980).  These  measures,  which  are  presented  in  Appendix  A,  were  used  to  examine  the 
possibility  that  individual  differences,  such  as  cognitive  processing  needs  or  verbal  ability,  account  for 
significant  differences  in  decisions  made  by  individuals  in  similar  organizational  and  situational  settings. 
Because  the  main  task  of  this  study  required  significant  cognitive  resources  in  terms  of  deep  thought, 
consideration  of  alternatives,  and  decision-making,  these  particular  covariates  were  chosen  to  evaluate 
individual  differences  in  cognitive  ability  and  cognitive  processing  styles. 

Need  for  Cognition  Scale.  The  Need  for  Cognition  Scale  (a  =  .88)  was  developed  by  Cacioppo 
and  Petty  (1982)  to  evaluate  the  extent  to  which  individuals  enjoy  engaging  in  effortful,  though- 
provoking  activities.  This  measure  has  shown  consistently  high  reliability  (a>.80)  across  a  number  of 
studies  in  different  settings  with  various  administration  procedures  (Cacioppo,  Petty  &  Kao,  1984;  Perri 
&  Wolfgang,  1988;  Sadowski,  1993),  as  well  as  high  convergent  and  discriminant  validities  (Cacioppo, 
Petty,  Feinstein  &  Jarvis,  1996).  For  this  measure,  participants  were  asked  to  indicate  the  degree  to  which 
each  of  18  statements  was  characteristic  of  them  on  a  scale  of  1  (not  at  all  like  me)  to  5  (very  much  like 
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me).  An  example  of  a  statement  on  the  Need  for  Cognition  Scale  is,  “I  find  satisfaction  deliberating  hard 
and  for  long  hours.” 

Cognitive  Flexibility  Scale.  The  Cognitive  Flexibility  Scale  (a  =  .75)  was  developed  by  Martin 
and  Rubin  (1995)  to  evaluate  the  extent  to  which  individuals  are  likely  to  evaluate  a  number  of  options  or 
alternatives  when  making  a  single  decision.  In  this  12-item  questionnaire,  participants  were  asked  to  rate 
their  agreement  with  a  number  of  statements  on  a  scale  from  1  (strongly  disagree)  to  6  (strongly  agree). 
One  example  item  is,  “I  am  willing  to  listen  and  consider  alternatives  for  handling  a  problem.”  High 
internal  consistency  coefficients  have  been  reported  for  this  measure  (a  =  .83),  along  with  construct 
validity  evidenced  by  strong  positive  correlations  with  measures  of  communication  and  behavioral 
flexibility  and  strong  negative  correlations  with  measures  of  cognitive  rigidity  (Martin  &  Rubin,  1995). 

Verbal  Reasoning  Measure,  The  Employee  Aptitude  Survey — Verbal  Reasoning  Scale  (a  =  .80) 
(Ruch  &  Ruch,  1980)  is  a  general  logic  test  intended  to  evaluate  participants’  general  verbal  abilities.  This 
measure  consists  of  six  sets  of  facts  from  which  participants  are  asked  to  draw  several  conclusions  for 
each  set  in  a  five-minute  time  period.  Scores  on  this  measure  reflect  the  degree  to  which  respondents  can 
quickly  draw  correct  conclusions  based  on  an  ambiguous  set  of  facts. 

Decision-Making  Task 

Task  Description  and.  Organizational  Overview.  The  second  phase  of  this  study,  the  actual 
decision  phase,  took  the  remaining  two  and  one-half  hours.  During  this  phase,  participants  were  asked  to 
take  on  the  role  of  a  senior  manager  for  E.A.F.,  Incorporated,  a  fictitious  Fortune  500  company  dealing 
primarily  in  oil  and  gas  refining  and  exploration.  First,  the  researcher  in  each  session  read  aloud  a  task 
description  and  instructions  for  the  decision  phase  of  the  study.  In  the  task  description,  participants  were 
presented  with  the  assignment  of  deciding  the  eligibility  of  individual  employees  for  promotion  to  a 
newly  created  job  within  the  organization.  This  new  assignment  was  for  an  individual  who  would 
become  the  corporate  liaison  between  this  company  and  its  competitors.  He  or  she  would  be  expected  to 
regularly  attend  technological  conventions,  to  meet  and  establish  working  relationships  with  members  of 
other,  possible  competitor,  organizations,  and  to  always  be  abreast  of  the  most  recent  advancements  made 
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both  within  the  organizations  research  and  development  labs  and  outside  the  organization.  Thus,  this 
position  would  be  one  of  some  sensitive  nature  where  company  sensitive  information  would  need 
protection. 

Specific  instructions  were  then  read  aloud  to  the  group.  Each  participant  was  told  that,  in  order  to 
make  the  promotion  decisions  described  in  the  task  description,  they  would  first  read  an  overview  of  the 
organization  in  order  to  understand  its  culture  and  values.  Next  they  would  need  to  read  through  a  set  of 
guidelines  intended  to  aid  the  decision-making  process.  Finally,  they  were  told  they  would  be  reading 
through  a  number  of  personnel  files  for  a  select  group  of  employees  who  were  being  considered  for  the 
position.  Based  on  the  information  in  each  of  these  files,  they  would  answer  a  set  of  questions  relating  to 
each  individual's  eligibility  for  promotion  to  the  sensitive  position. 

After  the  researcher  finished  reading  aloud  the  task  description  and  instructions,  participants  were 
asked  to  take  20-30  minutes  to  silently  read  through  an  organizational  overview  and  a  set  of  employment 
guidelines  that  contained  information  they  would  need  to  use  when  making  their  decisions.  Participants 
first  read  an  overview  of  the  organization,  including  its  history,  goals  and  culture. 

Development  of  the  organizational  overview  began  with  an  in-depth  review  of  organizational 
histories,  cultures,  and  mission  statements  of  several  major  oil  and  gas  companies  based  throughout  the 
world.  All  of  these  statements  were  available  via  the  World  Wide  Web  sites  of  each  major  company  and 
were  freely  available  to  visitors  to  the  website.  Components  from  a  number  of  the  statements  were  used 
to  create  a  realistic,  yet  original,  statement  of  history,  goals,  and  culture  for  our  fictitious  company, 
E.A.F.,  Inc.  The  organizational  overview  for  E.A.F.,  Inc.  described  a  company  founded  in  Texas  in  the 
early  1900s  which  grew  to  be  a  major  player  in  the  oil  and  gas  industry  by  early  1930.  Within  E.A.F.,  Inc. 
a  culture  exists  that  promotes  diversity  and  creative  or  innovative  ideas.  The  main  goals  of  E.A.F.,  Inc. 
are,  generally,  to  maintain  its  status  as  a  world  leader  in  energy  and  petrochemical  technology  and  to 
achieve  superior  financial  returns  for  all  shareholders.  An  example  of  all  Instructions  and  Organizational 
Overview  material  is  presented  in  Appendix  B. 
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Employment  Guidelines.  Each  participant  was  then  presented  with  the  employment  guidelines,  a 
set  of  disqualifying  and  mitigating  factors  that  they  should  use  to  decide  if  an  employee  is  eligible  for  the 
previously  described  job.  These  guidelines  were  exactly  the  same  for  all  participants.  They  were  told  that 
these  guidelines  were  established  by  the  company’s  board  of  directors  specifically  for  this  sensitive 
position. 

These  guidelines  were  based  on  the  actual  guidelines  that  personnel  security  adjudicators  use  to 
make  security  decisions.  These  guidelines  are  presented  on  the  Defense  Security  Service  (DSS)  website 
and  are  part  of  the  public  domain  (DSS,  2001).  The  original  adjudicative  guidelines  include  twelve  issues, 
or  security  concerns,  that  adjudicators  must  consider  when  making  security  decisions.  In  order  to  maintain 
simplicity  and  to  avoid  overwhelming  participants  with  reading  materials,  only  seven  of  these  issues  were 
included  in  the  employment  guidelines  provided  to  participants.  Also,  in  order  to  simplify  the  guidelines 
presented  in  this  study,  the  most  relevant  aspects  of  two  issues  were  sometimes  combined  to  represent  a 
single  complex  issue.  Issues  that  were  included  in  the  guidelines  were  1)  Personal  Conduct,  2)  Alcohol 
and  Drug  Involvement  (original  issues  Alcohol  Consumption  and  Drug  Involvement  combined),  3) 
Criminal  Conduct,  4)  Security  Violations  (original  issues  Security  Violations  and  Misuse  of  Information 
Technology  combined) ,  and  5)  Outside  Activities.  These  particular  issues  were  chosen  because  they  can 
be  logically  and  realistically  depicted  in  an  industrial  setting.  Five  issues  were  not  included  in  the 
guidelines  used  in  this  study  because  they  were  not  readily  apparent  as  issues  one  may  face  in  an 
industrial  setting.  These  issues  were  Allegiance  to  the  United  States,  Foreign  Influence,  Foreign 
Preference,  Sexual  Behavior,  and  Financial  Considerations.  An  example  of  one  issue  from  these 
guidelines  is  presented  in  Appendix  C. 

Practice  Case.  After  participants  finished  reading  through  the  organizational  overview  and 
employment  guidelines,  they  completed  a  practice  case  prior  to  evaluation  of  the  actual  security  cases. 
Together,  with  the  researcher  conducting  the  session,  they  read  through  an  example  case  and  discussed 
each  piece  of  information  provided,  whether  or  not  that  information  depicted  a  security  issue,  and  how  or 
if  any  obvious  issues  were  mitigated.  After  they  reviewed  all  the  information  in  the  file,  they  discussed 
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the  four  evaluation  questions  that  would  represent  their  decision  to  promote  the  employee  or  not:  1)  Is 
this  employee  eligible,  according  to  EAF,  Inc.’s  “Guidelines  for  Determining  Eligibility  for  Access  to 
Company  Sensitive  Information,”  for  promotion  to  the  position  of  Senior  Technology  Representative?  2) 
Would  you  recommend  this  employee  for  promotion?  3)  Please  give  specific  reasons  why  you  would  or 
would  not  recommend  this  employee  for  promotion;  and  4)  What  information  presented  in  the  employee’s 
security  file  was  most  important  to  you  in  making  the  decision  to  recommend  this  employee  for 
promotion?  The  researcher  presented  both  good  and  bad  examples  of  answers  to  each  question.  At  this 
point,  the  researcher  indicated  that  if  participants  were  unsure  whether  or  not  an  employee  was  eligible, 
they  could  indicate  “maybe”  on  the  answer  sheet.  Also,  the  researcher  explained  that  it  was  possible  to 
find  an  employee  eligible  (according  to  the  guidelines),  but  choose  not  to  promote  that  employee  based  on 
other  available  information.  Next,  the  researcher  emphasized  the  importance  of  using  the  employment 
guidelines  when  answering  the  evaluation  questions  as  well  as  the  importance  of  judging  each  case  on  its 
own  merits  and  not  comparing  each  case  to  the  other  cases  being  evaluated.  Finally,  the  participants  were 
given  a  chance  to  ask  any  questions  they  had  regarding  the  task  at  hand. 

Personnel  Security.  Files.  Subsequently,  each  participant  was  presented  with  a  number  of 
employee  files  or  cases.  These  files  contained  any  disciplinary  action  taken  while  the  employee  has 
worked  with  the  company,  any  recommendations  or  referrals  for  that  employee,  the  report  of  a  security 
interview  with  the  employee,  and  any  legal  or  financial  trouble  the  employee  has  had  in  his  or  her 
personal  life.  Fictitious  case-files  were  developed  based  on  a  review  of  actual  personnel  security  files. 
Additionally,  issues  relevant  to  the  oil  and  gas  industry  were  presented  and  any  security  issues  were  based 
on  the  issues  listed  in  the  employment  guidelines.  In  order  to  ensure  realism,  all  addresses  and  phone 
numbers  included  actual  streets,  zip  codes,  area  codes,  and  phone  prefixes  that  are  currently  used  in  the 
Houston,  Texas  metropolitan  and  surrounding  areas. 

Several  pieces  of  information  were  included  in  each  personnel  case-file.  First,  a  cover  sheet 
identified  all  documents  that  were  included  in  the  file.  Next,  each  employee  underwent  a  security 
interview  which  entailed  a  written  “Report  of  Security  Interview”  that  was  the  main  component  of  each 
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file.  The  “Report  of  Security  Interview”  provides  information  relative  to  each  potential  security  issue  and 
other  information  that  might  be  relevant  to  the  decision-maker.  Next,  each  employee  was  asked  to  provide 
the  names  of  two  personal  references.  These  references,  their  contact  information,  and  their 
recommendations  are  listed  on  the  “Personal  References”  page.  The  immediate  supervisor  of  each 
employee  also  submitted  his  or  her  recommendation  for  promotion,  which  is  detailed  in  the  “Supervisor 
Report”.  Finally,  every  case-file  included  a  summaiy  of  the  employee’s  yearly  performance  evaluation, 
which  provided  information  regarding  work  competence  and  performance.  Additional  pieces  of 
information  were  presented  in  case-files  only  when  necessary  to  document  a  security  issue  or  other 
relevant  performance  information.  These  supplemental  materials  are  presented  in  Figure  1. 

It  is  important  to  note  that  case-files  presented  to  participants  varied  in  ambiguity  and  complexity 
in  order  to  make  them  appear  more  realistic.  Additionally,  some  employees  were  obviously  eligible,  some 
obviously  ineligible,  and  others’  eligibility  status  was  less  clear.  Finally,  the  gender  of  candidates  and 
presentation  of  security  issues  were  distributed  evenly  across  the  fifteen  cases. 


Figure  1.  Supplemental  Case  File  Documents 

Document 

Report  of  Commendation 

Information  Included: 
details  about  cases  where  the  employee  had 
performed  some  beneficial  act  that  had  helped  either 
the  company  or  another  employee  and  reflected  well 
on  the  integrity  of  that  individual 

Reports  of  Discipline 

details  about  instances  in  which  the  employee  had 
violated  a  company  rule  or  otherwise  acted  in  a 
manner  not  conducive  to  company  success 

Local  Law  Enforcement  Agency  Records 

indices  of  criminal  activities  occurring  in  the  Houston 
area  including  criminal  charge,  whether  or  not  the 
individual  was  convicted,  and  any  sentencing  as  a 
result  of  conviction 

State  Law  Enforcement  Agency  Records 

information  of  criminal  activity  within  the  state  of 

Texas  including  criminal  charge,  whether  or  not  the 
individual  was  convicted,  and  any  sentencing  as  a 
result  of  conviction 

Additional  Records 

follow-ups  to  the  security  interview  or  responses  to  a 
supervisor’s  report  or  performance  evaluation  issued 
when  additional  information  was  provided  outside 
the  scope  of  standard  documentation;  notation  made 
in  the  “comments”  section  of  the  cover  page 
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Experimental  Manipulations 

Organizational  Influences,  Judgment  intent,  evaluation  expectancy,  and  risk-level  were 
manipulated  in  the  information  that  the  participant  was  provided  regarding  the  nature  of  the  decisions  and 
the  organizational  culture.  Judgment  intent  was  manipulated  in  the  organizational  overview.  Participants 
were  told  one  of  two  things:  1)  that  the  organization  believes  in  developing  its  employees  to  the  fullest 
and  feels  it  is  necessaiy  to  evaluate  potential  employees  not  solely  on  eligibility  for  a  position,  but  on 
their  ability  to  develop  into  that  position;  or  2)  that  the  organization  believes  that  it  is  necessary  to  fit 
employees  to  positions  and  therefore,  an  employee  must  be  fully  eligible  for  that  position  at  the  time  of 
employment  or  promotion. 

Next,  evaluation  expectancy  was  manipulated  in  the  instructions  given  to  the  participants.  In  one 
condition,  no  evaluation,  participants  were  told  to  decide  the  eligibility  of  each  employee,  and  that  these 
decisions  would  be  sent  to  the  company  president  who  would  make  a  final  decision.  In  the  second 
condition,  evaluation  expectancy,  participants  were  told  that  their  eligibility  decisions  would  be  reviewed 
for  accuracy  by  a  more  senior  manager  who  would  then  give  his  or  her  referral  to  the  company  president. 
In  order  to  reinforce  this  condition,  participants  were  instructed  to  turn  in  the  first  three  cases  they 
completed  so  that  an  executive  from  E.A.F.,  Inc.  could  begin  evaluating  the  cases  immediately.  After 
everyone  turned  in  their  first  three  cases,  an  experimental  confederate  posing  as  an  E.A.F.,  Inc. 
representative  came  to  gather  the  completed  cases  to  take  to  the  fictitious  waiting  executive. 

Task  Demands.  Risk-level  was  manipulated  in  the  task  description.  In  the  high-risk  condition, 
participants  were  told  that  the  position  they  are  evaluating  for  is  very  sensitive  in  nature  and  that  the 
individual  who  receives  this  position  must  be  a  veiy  trustworthy  individual.  The  individual  must  be 
willing,  at  all  costs,  to  protect  the  organization.  In  the  low-risk  condition,  participants  were  told  simply 
that  the  position  is  sensitive  and  the  individual  selected  must  be  willing  to  uphold  the  company  values.  In 
order  to  emphasize  the  risk  involved  in  the  high-risk  condition,  participants  were  told  that,  because  it  was 
extremely  necessaiy  for  them  to  make  good  decisions,  if  a  review  of  their  decision  showed  that  they  had 
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not  put  forth  a  concerted  effort,  they  could  lose  one  experimental  credit.  In  actuality,  all  participants 
received  the  same  amount  of  credit  and  no  participants  were  penalized  based  on  their  decisions. 

Finally,  workload  was  manipulated  in  the  actual  number  of  cases  given  to  participants.  High 
workload  consisted  of  fifteen  cases  and  low  workload  consisted  of  seven  cases.  To  emphasize  workload, 
participants  were  told  that  each  case  would  take  seven  to  ten  minutes  and  that  they  had  either  seven  cases 
and  two  hours  to  complete  them  (low  workload)  or  fifteen  cases  and  only  two  hours  to  complete  them 
(high  workload).  Participants  in  the  high  workload  condition  were  also  told  that  it  was  important  that  they 
evaluate  every  case  before  they  could  leave. 

Personnel  Security  File  Expert  Evaluation. 

After  all  cases  were  written,  they  were  rated  by  three  raters  with  extensive  experience  in  DOD 
personnel  security  adjudication  and  familiarity  with  the  adjudicative  guidelines.  First,  raters  were 
provided  copies  of  the  task  description,  instructions,  and  organizational  overview.  Next,  each  rater  was 
asked  to  read  through  each  case  carefully  and  rate  each  case  on  its  realistic  nature  (1 — not  at  all  realistic 
to  5 — very  realistic),  complexity  of  issues  (1 — not  complex  to  3 — very  complex),  and  overall  ambiguity 
(1 — not  ambiguous  to  3 — very  ambiguous).  Next,  raters  were  asked  to  indicate  on  a  checklist  the  issues 
(personal  conduct,  alcohol  and  drub  involvement,  criminal  conduct,  security  breaches,  or  outside 
activities)  represented  in  each  case.  Finally,  the  raters  were  asked  to  indicate  if  they  felt  the  individual  in 
each  case  should  be  eligible  for  access  to  company  sensitive  information  (1 — yes,  2 — maybe,  or  3 — no). 

Analysis  of  raters  responses  indicate  that  raters  agreement  somewhat  varied  for  the  realistic 
nature  of  the  case,  complexity  of  issues,  and  overall  ambiguity,  with  76,  62,  and  76  percent  agreement, 
respectively.  Raters  agreed  that  all  cases  were  somewhat  to  veiy  realistic.  Specifically,  five  cases  were 
rated  as  “somewhat  realistic”,  while  the  remaining  ten  cases  were  rated  as  “realistic”  or  “very  realistic.” 
Rater  agreement  was  lower  regarding  the  complexity  of  the  issues  presented  in  each  case.  Individual 
baselines  for  what  constitutes  complexity  of  security  cases  may  have  been  different  for  each  rater  because 
two  of  the  raters  have  substantially  more  experience  dealing  with  more  complex  cases  than  one  rater. 
Results  for  issue  complexity  reveal  that  five  cases  were  deemed  to  be  “somewhat  complex,”  while  ten 
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cases  were  characterized  as  “not  complex.”  No  cases  were  characterized  as  being  “very  complex”  by  the 
expert  panel.  Finally,  raters  generally  agreed  that  the  cases  presented  here  were  not  ambiguous.  Three 
cases  were  rated  as  “somewhat  ambiguous,”  while  the  remaining  twelve  cases  were  deemed  “not 
ambiguous.”  Although  our  initial  intent  was  to  vary  the  complexity  and  ambiguity  of  these  cases,  they 
remain  significantly  less  complex  and  more  straight-forward  than  actual  department  of  defense  security 
cases. 

When  identifying  the  disqualifying  factors  presented  in  each  case,  raters  identified  the  intended  issues  in 
twelve  of  the  fifteen  cases.  Overall,  personal  conduct  was  identified  as  an  issue  in  nine  cases,  alcohol  and 
drug  involvement  was  present  in  five  cases,  criminal  conduct  was  represented  by  four  cases,  security 
violations  were  issues  in  five  cases,  and  outside  activities  were  described  in  three  cases.  Raters  also 
indicated  whether  or  not  each  individual  was  eligible  for  access  to  company  sensitive  information  or  not. 
Five  cases  were  rated  as  absolutely  or  probably  eligible,  three  cases  were  considered  possibly  eligible  or 
possibly  ineligible,  and  seven  cases  were  rated  as  probably  or  absolutely  ineligible.  These  ratings  in 
particular  are  important  because  they  will  be  used  as  the  baseline  by  which  the  accuracy  of  participants’ 
decisions  will  by  judged.  Overall,  participants’  decisions  for  the  fifteen  cases  were  not  significantly 
correlated  with  expert  decision  (r=.50,  p>.  1 0).  Table  1  presents  the  percent  of  security  decision-makers 
who  agreed  with  the  expert  decision  for  each  case. 

Dependent  variables 

Participants  were  asked  to  review  each  case  and  take  into  consideration  the  appropriate 
guidelines.  They  were  asked  to  indicate  1)  if  the  employee  is  eligible  for  promotion,  2)  the  reasons  the 
employee  should  or  should  not  be  promoted,  3)  the  information  that  was  most  important  in  the  case,  and 
4)  the  time  it  took  to  complete  the  file  review.  Based  on  these  questions,  scores  can  be  obtained  for  each 
of  four  dependent  variables. 

Consistency.  Consistency  is  defined  as  the  extent  to  which  participants  identified  the  issues  and 
mitigating  factors  in  a  manner  consistent  with  the  adjudicative  guidelines.  Particularly,  scores  are  based 
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Table  1.  Percent  of  Security  Decision-Makers  Who  Agreed  with  Expert  Decisions 

Case  Number 

Expert  Decision 

%  Agreement 

1 

Yes 

99 

2 

Maybe 

3 

3 

No 

93 

4 

Yes 

91 

5 

No 

61 

6 

No 

31 

7 

Yes 

92 

8 

No 

43 

9 

Yes 

98 

10 

Yes 

76 

11 

No 

98 

12 

Maybe 

0 

13 

No 

53 

14 

Maybe 

0 

15 

No 

29 

Average  %  agreement  with 

“Yes”  decisions: 

91% 

Average  %  agreement  with 

“Maybe”  decisions: 

1% 

Average  %  agreement  with 

“No”  decisions: 

58% 

Average  %  agreement  with  all  expert  decisions: 

58% 

on  the  number  of  issues  and  mitigating  factors  that  were  identified  and  used  to  make  eligibility 
decisions.  Consistency  scores  range  from  zero  (0)  to  four  (4)  based  on  the  information  presented  in 
responses  to  questions  three  and  four  ( What  information  presented  in  the  employee ’s  security  file  was 
most  important  to  you  in  making  the  decision  to  recommend  this  employee  for  promotion ?)  with  high 
scores  representing  more  consistent  application  of  the  employment  guidelines.  The  specific  scoring 
protocol  is  presented  in  Figure  2. 

Accuracy  Accuracy  refers  to  the  extent  to  which  the  participant’s  answer  to  question  number  one 
(Is  this  employee  eligible,  according  to  EAF,  Inc.  ’s  “Guidelines  for  Determining  Eligibility  for  Access  to 
Company  Sensitive  Information,  ’’for  promotion  to  the  position  of  Senior  Technology  Representative ?)  is 
consistent  with  the  raters’  eligibility  decision.  Participants  were  given  the  opportunity  to  answer  “yes”, 
“no”,  or  “maybe”  to  this  question.  Accuracy  will  be  scored  0 — not  accurate/did  not  agree  with  expert 
rating,  or  1 — accurate/did  agree  with  expert  rating.  This  scoring  protocol  is  presented  in  Figure  3. 
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Figure  2.  Scoring  Protocol  for  Consistency  Scores 

QUESTION  THREE  RESPONSE 

No  information  relating  to  guidelines 

Ex:  “a  good  worker” 

Score  A 

0 

Specific  mention  of  issues  not  present  in  case 

Ex:  “no  alcohol  or  drug  abuse” 

1 

Specific  mention  of  issues  present  in  case 

Ex:  “took  secret  files  home” 

“friends  work  for  competitor” 

2 

Specific  mention  of  both  issues  present  in  case 
and  issues  not  present  in  case 

Ex:  “former  drug  problems  but  no 

relationships  with  competition” 

3 

OUESTION  FOUR  RESPONSE 

Unrelated  to  guidelines 

Ex:  “good  recommendations” 

Score  B 

0 

Related  to  guidelines 

Ex:  “recent  drug  use” 

. 

CONSISTENCY  SCORE  =  Score  A  +  Score  B 

Figure  3.  Scoring  Protocol  for  Accuracy  Scores 

Expert  Response 

Particant  Response 

Accuracy  Score 

Yes 

Yes 

1 

No 

0 

Maybe 

0 

No 

Yes 

0 

No 

1 

Maybe 

0 

Maybe 

Yes 

0 

No 

0 

Maybe 

1 

Timeliness.  As  displayed  in  Figure  4,  timeliness  is  simply  the  amount  of  time  it  took  each 
participant  to  complete  the  evaluation  of  each  security  case.  Participants  were  asked  to  note  on  the  case 
cover  sheet  both  the  time  they  started  and  the  time  they  finished  evaluating  the  case.  The  actual  number  of 
minutes  taken  to  complete  each  case  reflects  the  score  for  timeliness.  In  an  inverse  scale,  cases  taking 
fewer  minutes  are  more  timely,  while  cases  taking  more  minutes  are  less  timely. 
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Figure  4,  Example  of  Scoring  Protocol  for  Timeliness _ 

Time  Began:  6:45 
Time  Ended:  7:56 

Total  Time  to  Complete  Case:  1 1  minutes _ 

_ Timeliness  Score  =  1 1 _  _ _ 

Quality.  Quality  refers  to  the  actual  quality  of  the  answers  provided  to  question  three  (Please  give 
specific  reasons  why  you  would  or  would  not  recommend  this  employee  for  promotion.)  Each  response 
was  rated  by  three  independent  raters  for  overall  sentence  structure  and  coherence  to  yield  a  single  quality 
rating  for  each  response.  Quality  ratings  ranged  from  1  (low  quality)  to  5  (high  quality)  with  interrater 
agreement  coefficients  in  the  mid-80s. 

Before  raters  began  the  task  of  evaluating  response  quality,  a  randomly  selected  group  of 
responses  was  evaluated  in  order  to  establish  benchmarks,  or  specific  examples  of  quality,  at  five  discrete 
levels.  This  review  entailed  reading  each  of  the  randomly  selected  responses  and  sorting  the  responses 
into  five  groups:  very  low  quality,  low  quality,  medium  quality,  and  high  quality,  and  very  high  quality. 
After  this  sorting  task  was  complete,  the  response  that  best  represented  the  quality  level  in  each  group  was 
established  as  the  benchmark  for  quality  at  that  level.  These  benchmarks,  which  are  presented  in  Figure  5, 
were  provided  to  each  rater  to  use  a  guide  in  making  quality  evaluations. ,  the  mean  rating  for  each 
response  was  used  as  final  quality  score.  Therefore,  quality  scores  range  between  one  (1)  and  five  (5), 
with  higher  scores  indicative  of  higher  quality  responses. 

Analytical  Approach 

Four  2  (developmental  judgment  intent  v.  guideline-driven  judgment  intent)  x  2  (low  evaluation 
expectancy  v.  high  evaluation  expectancy)  x  2  (low  risk  v.  high  risk)  x  2  (low  workload  v.  high  workload) 
between  subjects  analyses  of  variance  (ANOVAs)  will  be  conducted.  Analyses  of  covariance 
(ANCOVAs)  will  be  used  when  any  one  or  more  of  the  covariate  measures  shows  a  significant 
relationship  with  a  dependent  variable. 
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Figure  5.  Benchmarks  for  Quality  Scores 

Oualitv  Ratine 

Benchmark 

1 

“trustworthy” 

2 

“the  unsureness  of  her  coworkers  and  managers  for  her  promotion” 

3 

“--standard  work  performance 
—gets  drunk  occasionally 
—incident/why  would  he  show  them? 

-good  guy  (not  exceptional)” 

4 

“He  is  said  to  be  a  ‘good  guy’  in  his  recommendation;  he  was 
honest  about  his  mistakes  and  prior  security  issues.” 

5 

“Based  on  the  guidelines,  I  would  recommend  her  for  promotion 
because  she  had  one  security  breach  that  has  been  cleared  up.  She 
was  suspended  without  pay  for  2  weeks  and  went  to  counseling. 

Elizabeth’s  work  knowledge  can’t  help  her  husband  anymore,  so 
that  is  not  a  concern.” 

Results 

Correlational  Analyses 

An  initial  look  at  correlations  between  the  dependent  and  independent  variables  as  well  as  the 
covariate  measures  revealed  several  significant  correlations,  which  are  presented  in  Table  2.  Particularly, 
consistency  was  positively  related  to  both  risk  and  workload  (r=.25,  p<.001;  r=.18,  p<.01,  respectively) 
indicating  a  possible  influence  of  task  demands  on  response  consistency.  Accuracy  scores  were  positively 
correlated  with  Need  for  Cognition  scores  (r=.16,  p=.01)  and  negatively  correlated  with  workload  (r=-.42, 
p<.001).  The  amount  of  time  spent  on  each  case  was  negatively  associated  with  verbal  reasoning  ability 
(r=-.13,  p=.05)  and  positively  related  to  Need  for  Cognition  (r=.14,  p=.03).  Time  was  also  significantly 
negatively  correlated  with  workload  (r=-.45,  p<.001)  and  positively  related  to  risk  (r=.43,  p<.001). 
Quality  was  positively  related  to  situational  risk  (r=.31,  p<.001). 

Overall,  these  relationships  appear  to  provide  some  evidence  for  the  construct  validity  of  our 
criterion  variables.  Table  2  also  presents  the  correlations  among  the  criterion  variables.  As  may  be  seen, 
the  various  criteria  evidenced  relatively  low  interrcorrelations.  Quality  was  significantly  correlated  with 
both  consistency  (r=.24,  p<-01)  and  timeliness  (r=.47,  p<.01),  while  response  accuracy  was  also 
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positively  correlated  with  timeliness  (r=.17,  p<.01).  These  findings  are  not  surprising  given  the  nature  of 
the  criterion  used.  Particularly,  the  more  time  participants  were  willing  to  take  to  complete  each  decisions 
was  related  to  both  accuracy  and  quality.  Because  both  accurate  and  high  quality  decisions  were  based  on 
more  extensive  cognitive  processing  and  information  structuring,  which  require  some  time,  it  is  not 
surprising  that  they  are  positively  related  to  the  amount  of  time  each  case  was  allocated.  These 
intercorrelations  among  the  four  dependent  variables  revealed  no  systematic  pattern  that  would  indicate 
dependence  among  any  of  the  criteria.  Therefore,  to  further  analyze  the  organizational  influences  and  task 


Table  2 

Inters  omlations  oflndependent  Variables,  Dependent  Variables,  and  Covamte 

$  cores 

l  2  4 

£ 

& 

7 

S.  2 

10 

M 

Independent  Variable 

1.  Worked  CO  .00  .00 

.25** 

.,43** 

•  45** 

.03  -.04 

-.13* 

-.13* 

.50 

.30 

2.  Ri>J:  .00  .00 

.18* 

.10 

.43** 

.33‘:'*  -01 

09 

04 

.50 

.30 

3.  Judgment  IrtenS  00 

.13 

.07 

.01 

.0?  03 

-Oi 

.06 

.50 

.50 

4 .  Evaluation  Expectancy 

-.04 

-.08 

.10 

.0!)  -.02 

06 

.12 

.50 

.50 

Dependent  Variable 

5,  Consistency 

-05 

.08 

.24**  06 

.02 

,10 

2,25 

.41 

6.  Accuracy 

,17** 

04  ,09 

.16* 

.12 

.63 

,12 

7,  Timeliness 

4?**  -.13 

.14* 

.04 

4,95 

145 

8,  Quality 

-02 

.10 

11 

3,66 

,69 

Covaxiafe 

9.  VeiballQ 

.13* 

.16* 

26.28 

6.16 

10.  Need  for  Cognition 

.50** 

59.72 

11.26 

1 1 .  Cognitive  Flexibility 

57.34 

6.11 

*V.0I;*p<-QS 

demand  characteristics  that  influence  decision  consistency,  accuracy,  timeliness,  and  quality,  independent 
analyses  of  variance  or  covariance  were  conducted  for  each  criterion. 

Analyses  of  Variance  and  Covariance 

Consistency.  ANCOVA  effects  presented  in  Table  3  revealed  that  Cognitive  Flexibility  had  a 
significant  main  effect  on  consistency  (Fi>223=5.95,  p=.03,  qp2=. 03),  with  greater  cognitive  flexibility 
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related  to  increased  response  consistency.  Controlling  for  the  effect  of  Cognitive  Flexibility,  several 
significant  main  effects  were  found,  as  well  as  several  two-  and  three-way  interaction  effects. 

First,  individuals  in  organizational  settings  where  development  and  rehabilitation  was  important 
were  less  likely  to  respond  consistently  with  the  employment  guidelines  (M=2.19,  sd=.40)  than 
individuals  in  organizations  where  development  was  not  stressed  (M=2.30,  sd=.42;  F=3.72,  p=.05, 
t]p2=.02),  a  finding  that  provides  support  for  Hypothesis  One.  No  significant  main  effect  was  found  for 
evaluation  expectancy.  However,  two  significant  two-way  interactions  emerged.  The  effect  of  evaluation 
expectancy  on  decision  consistency  was  different  under  conditions  of  high  as  opposed  to  low  risk 
(FU23=4.13,  p=.04,  qp2=.02).  When  the  likelihood  of  negative  consequences,  or  risk,  was  low,  participants 
who  anticipated  evaluation  provided  decision  rationale  that  was  less  consistent  with  the  employment 
guidelines  (M=2.14,  sd=.47)  than  participants  in  low  risk  conditions  who  did  not  expect  evaluation 
(M=2.24,  sd=.37).  This  finding  indicates  a  certain  amount  of  stress,  or  apprehension,  may  be  experienced 
when  individuals  anticipate  evaluation,  which  can  diminish  cognitive  resources  and  induce  a  lack  of  focus 
on  vital  decision-making  information  (Compton  &  Mintzer,  2001;  Seta,  Crisson,  Seta,  &  Wang,  1989). 

On  the  other  hand,  when  participants  understood  the  negative  consequences  of  poor  performance 
decisions  were  more  consistent  when  participants  expected  to  be  evaluated  (M=2.36,  sd=.39)  compared  to 
when  they  did  not  (M=2.29,  sd=.40). 

A  second  marginally  significant  two-way  interaction  that  sheds  some  light  on  how  evaluation 
expectancy  may  influence  response  consistency  occurs  between  evaluation  expectancy  and  workload 
(F  1,223=2  .75,  p=.l  1,  qp2=01).  Overall,  decisions  made  in  high  workload  conditions  were  more  consistent 
than  those  made  when  workload  was  low,  regardless  of  evaluation  expectancy.  However,  in  low  workload 
conditions  with  low  evaluation  expectancy,  decisions  were  more  consistent  (M=2.19,  sd=.41)  than  those 
made  with  a  smaller  workload  and  high  evaluation  expectancy  (M=2.10,  sd=.48),  indicating  that 
workload  perceptions  may  play  a  role  in  inducing  stress  along  with  evaluation  pressure.  This  effect  of 
workload  is  apparently  eliminated  with  practice,  however,  a  point  indicated  in  the  slightly  higher 
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consistency  scores  for  decisions  in  high  workload  conditions  with  high  evaluation  expectancy  (M=2.37, 
sd=.36)  relative  to  decisions  in  high  workload  conditions  with  low  evaluation  expectancy  (M=2.34,  .34). 

Risk  also  had  a  significant  main  effect  on  response  consistency  (F=7.93,  p=.01,  t|p2=.03).  High 
risk  tasks  (M=2.32,  sd=.39)  yielded  much  more  consistent  decisions  than  low  risk  tasks  (M=2.18, 
sd=.43),  which  is  consistent  with  Hypothesis  Four.  When  individual  decision-makers  understand  the 
likelihood  of  negative  consequences  for  poor  performance,  they  appear  to  use  more  relevant  information 
when  providing  rationale  for  their  decisions.  Workload  also  had  a  significant  main  effect  on  consistency 


Table  3.  Analysis  of  Covariance  of  Consistency  Scores  as  a  Function  of  Workload,  Risk, 
Judgment  Intent,  and  Evaluation  Expectancy,  With  Cognitive  Flexibility  Scores  as  Covariate 

Source 

df 

MS 

F 

E 

_  2 

Be 

Cognitive  Flexibility 

1 

.892 

5.95 

.03 

.03 

Judgment  Intent  (JI) 

1 

.558 

3.72 

.05 

.02 

Evaluation  Expectation  (EE) 

1 

.125 

.83 

.38 

.00 

Workload  (W) 

1 

2.957 

19.72 

.00 

.08 

Risk  (R) 

1 

1.189 

7.93 

.01 

.03 

W  xR 

I 

.414 

2.76 

.10 

.01 

Wx  JI 

1 

.121 

.81 

.37 

.00 

W  x  EE 

I 

.413 

2.75 

.11 

.01 

Rx  JI 

1 

.019 

.12 

.74 

.00 

R  x  EE 

1 

.619 

4.13 

.04 

.02 

JI  x  EE 

1 

.007 

.05 

.83 

.00 

W  x  R  x  JI 

1 

.353 

2.35 

.13 

.01 

W  x  R  x  EE 

1 

.162 

1.08 

.30 

.01 

W  x  JI  x  EE 

1 

.000 

.00 

.97 

.00 

R  x  JI  x  EE 

1 

.156 

1.04 

.31 

.01 

WxRxJIxEE 

1 

.111 

.74 

.39 

.00 

Error 

223 

.150 

Total 

239 

.171 
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(Fi, 223=1 9.72,  pc.OOl,  t|p2=.08).  Decisions  made  in  low  workload  conditions  were  significantly  less 
consistent  with  the  employment  guidelines  (M=2.15,  sd=. 45)  than  those  made  in  high  workload  settings 
(M=2.35,  sd=.35).  Although  this  finding  is  inconsistent  with  Hypothesis  Five,  it  indicates  a  likely  practice 
effect  where  response  consistency  increases  as  more  decisions  are  made. 

A  marginally  significant  interaction  (F!  223=2.76,  p=.10,  t|p2=.01)  between  risk  and  workload 
provides  some  insight  to  their  effects  on  response  consistency.  Specifically,  when  risk  and  workload  were 
both  high,  decisions  were  more  consistent  with  the  employment  guidelines  (M=2.38,  sd=.34)  than  when 
risk  was  high  and  workload  was  low  (M=2.26,  sd=.43).  In  a  similar  pattern,  when  risk  was  low  and 
workload  was  high  (M=2.32,  sd=.36),  consistency  scores  were  higher  than  when  risk  and  workload  were 
both  low  (M=2.03,  sd=.45).  These  results  point  both  to  the  practice  effects  of  high  workload  and  to  an 
economic  approach  to  applying  the  guidelines  in  which  decisions  are  consistent  so  long  as  decision¬ 
makers  have  enough  time  and  understand  that  negative  consequences  are  a  possibility. 

Low  risk/low  workload  conditions  produced  the  least  consistent  responses  while  high  risk/high 
workload  conditions  produced  the  most  consistent  responses,  indicating  that  practice  combined  with  the 
potential  for  negative  consequences  may  direct  more  attention  to  important  decision-relevant  information 
regardless  of  judgment  intent. 

This  is  evidenced  in  a  marginally  significant  three-way  interaction  between  risk,  workload,  and  judgment 
intent  (Fi>223=2.35,  p=.13,  t|p2=.01).  Decisions  made  in  guideline-driven  judgment  conditions  were  more 
likely  to  be  consistent  with  the  employment  guidelines  when  risk  was  high  and  workload  was  low 
(M=2.37,  sd=.44)  compared  to  decisions  made  in  developmental  judgment  conditions  with  high  risk  and 
low  workload  (M=2.15,  sd=.39).  When  risk  and  workload  were  low,  there  was  little  difference  between 
decisions  made  in  environments  where  judgments  were  guideline-driven  (M=2.08,  sd=.43)  and  where 
development  was  stressed  (M=1.98,  sd=.46).  In  high  workload  conditions,  there  were  no  significant 
differences  between  decision  made  under  guideline-driven,  as  opposed  to  developmental,  judgments. 
Specifically,  in  low  risk/high  workload  settings,  consistency  in  developmental  conditions  (M=2.24, 
sd=.34)  was  slightly  lower  than  consistency  in  guideline-driven  conditions  (M=2.39,  sd=.37)  and  in  high 
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risk/high  workload  conditions,  consistency  was  the  same  for  developmental  (M=2.39,  sd=.31)  and 
guideline-driven  (M=2.37,  sd=  36)  decisions. 

Accuracy.  As  presented  in  Table  4,  Need  for  Cognition  had  a  significant  main  effect  on  decision 
accuracy  (Fi?223=5.22,  p=.02,  t|p2=.02),  specifying  that  individuals  who  enjoy  tasks  that  require  extensive 
cognitive  processing  made  more  accurate  decisions.  After  controlling  for  Need  for  Cognition,  evaluation 
expectancy  (Fi223=2.60,  p=.  1 1,  rjp2=  01),  risk  (Fi  223=2. 60,  p=.l  1, r|p2=. 01),  and  workload  (Fl5223=51.54, 
p<.001,  r|p2=.19)  were  important  factors  in  decision  accuracy. 


Table  4.  Analysis  of  Covariance  of  Accuracy  Scores  as  a  Function  of  Workload,  Risk,  Judgment 


Intent,  and  Evaluation  Expectancy,  With  Need  for  Cognition  Scores  as  Covariate  j 

Source 

df 

MS 

F 

P 

a/ 

Need  for  Cognition 

1 

.059 

5.22 

.02 

.02 

Judgment  Intent  (JI) 

1 

.019 

1.73 

.19 

.01 

Evaluation  Expectation  (EE) 

1 

.029 

2.60 

.11 

.01 

Workload  (W) 

1 

.589 

51.54 

.00 

.19 

Risk  (R) 

1 

.029 

2.60 

.11 

.01 

WxR 

1 

.080 

6.96 

.01 

.03 

W  x  JI 

1 

.002 

.21 

.65 

.00 

W  x  EE 

1 

.026 

2.23 

.14 

.01 

R  x  JI 

1 

.004 

.35 

.55 

.00 

R  x  EE 

1 

.104 

9.09 

.00 

.04 

JI  x  EE 

1 

.053 

4.61 

.03 

.02 

WxRxJI 

1 

.008 

.71 

.40 

.00 

W  x  R  x  EE 

1 

.001 

.06 

.82 

.00 

W  x  JI  x  EE 

1 

.000 

.00 

.95 

.00 

R  x  JI  x  EE 

1 

.002 

.16 

.69 

.00 

WxRxJIxEE 

1 

.000 

.01 

.93 

.00 

Error 

223 

.011 

Total  239  .015 
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In  organizational  settings  where  evaluation  expectancy  was  low,  decision-makers  made 
somewhat  more  accurate  decisions  (M=. 64,  sd=.  12)  than  when  evaluation  expectancy  was  high  (M=.62, 
sd=.12).  Although  this  finding  is  not  exceptionally  strong  and  appears  contradictory  to  Hypothesis  Three, 
the  analysis  of  two-way  interactions  of  evaluation  expectancy  with  1  judgment  intent  and  2)  risk  suggest 
that  evaluation  expectancy  is  an  important  factor  in  decision  accuracy. 

The  first  significant  two-way  interaction  occurs  between  two  organizational  influence  variables, 
evaluation  expectancy  and  judgment  intent  (Fi ,223=4.61,  p=.03,  t|p2=.02).  When  developmental  judgments 
were  stressed,  decision-makers  who  expected  to  be  evaluated  made  significantly  less  accurate  decisions 
(M=.59,  sd=.  12)  than  those  who  did  not  expect  to  be  evaluated  (M=.64,  sd=.13),  while  individuals  in 
guideline-driven  judgment  conditions  made  equally  accurate  decisions  insensitive  to  high  (M=.63, 
sd=.12)  or  low  (M=.63,  sd=.12)  evaluation  expectancy. 

Again,  this  finding  illustrates  a  stress  effect  that  is  particularly  salient  in  conditions  where 
developmental  judgments  were  emphasized.  One  explanation  for  this  is  that  a  developmental  judgment 
allows  for  a  large  degree  of  leniency  in  security  decision-making  and  does  not  emphasize  the  necessity  of 
using  the  employment  guidelines  to  support  security  decisions.  Subsequently,  decision-makers  in 
developmental  judgment  conditions  experienced  a  lack  of  clarity  regarding  what  constituted  “right”  or 
“wrong”  decisions.  This  lack  of  clarity  in  concert  with  evaluation  apprehension  apparently  led  to  less 
accurate  decision-making.  More  precisely,  when  participants  were  unsure  of  what  the  “correct”  decision 
should  be,  their  decisions  were  less  accurate.  However,  when  guideline-driven  standards  existed,  meaning 
decision-makers  understood  (based  on  the  guidelines)  why  each  decision  was  right  or  wrong,  evaluation 
apprehension  was  not  a  factor. 

As  noted  above,  situational  risk  interacts  with  evaluation  apprehension  to  influence  decision 
accuracy.  Situational  risk  alone  exerts  only  a  marginally  significant  influence  on  decision  accuracy 
(Fi,223=2.60,  p=.l  1,  t|p2=. 01);  decisions  made  in  high  risk  conditions  were  slightly  more  accurate  (M=.64, 
sd=.12)  than  those  made  in  low  risk  conditions  (M=.62,  sd=.12).  However,  the  interaction  of  risk  and 
evaluation  expectation  reveals  that  both  are  important  factors  in  decision  accuracy  (Fi  223=9.09,  p<.001, 
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t|p2=.04).  In  low  risk  conditions  where  negative  outcomes  were  inconsequential,  decisions  made  in  high 
evaluation  expectancy  conditions  were  significantly  less  accurate  (M=. 58,  sd=.13)  that  those  made  under 
low  evaluation  expectancy  (M=.64,  sd=.13).  The  stress  caused  by  evaluation  anticipation  may  lead  to  less 
effective  cognitive  processing  for  the  decision-maker  and  less  accurate  security  decisions.  This  effect  is 
obviated,  however,  when  the  potential  for  negative  consequences  is  high.  In  high  risk  conditions,  there 
was  not  significant  difference  between  those  decisions  made  by  individuals  who  expected  to  be  evaluated 
(M=.65,  sd=.l  1)  and  those  who  did  not  (M=.63,  sd=.12).  Therefore,  in  high  risk  situations,  evaluation 
apprehension  is  likely  eliminated,  possibly  because  the  desire  to  avoid  negative  consequences  outweighs 
the  desire  to  please  evaluators.  In  low  risk  situations,  however,  evaluation  apprehension  is  likely  to  lead  to 
diminished  decision  accuracy  because  the  decision-maker’s  focus  lies  on  the  evaluation  rather  than  the 
decision  to  be  made. 

Workload,  as  a  situational  demand,  had  a  highly  significant  main  effect  for  decision  accuracy 
(Fi  223=51.54,  pc.OOl,  t|p2=.  19)  with  decision-makers  in  high  workload  conditions  (M=.57,  sd=.10) 
making  less  accurate  decisions  than  those  in  low  workload  conditions  (M=.67,  sd=.12).  This  result  is 
consistent  with  Hypothesis  Five,  indicating  that,  although  workload  may  enhance  attention  or 
understanding  of  guidelines  through  practice,  as  seen  for  response  consistency,  the  time  pressure  induced 
when  workload  is  high  does  have  an  overall  negative  impact  on  decision  accuracy. 

Workload  also  had  a  significant  influence  on  the  manner  in  which  risk  affected  decision  accuracy 
(Fi, 223=6.96,  p<.01,  t|p2=. 03).  In  low  risk  conditions,  decisions  were  substantially  more  accurate  when 
workload  was  low  (M=.68,  sd=.12)  than  when  workload  was  high  (M=.54,  sd=.10).  From  an  economic 
perspective,  when  negative  outcomes  are  unlikely  and  there  is  an  abundance  of  work  to  do,  decision¬ 
makers  may  become  somewhat  sloppy,  or  even  arbitrary,  when  making  security  decisions.  Accordingly, 
in  high  risk  situations,  decisions  were  less  accurate  when  workload  was  high  (M=.60,  sd=.10)  as  opposed 
to  when  it  was  low  (M=. 67,  sd=.12).  Thus,  even  when  negative  outcomes  are  likely,  the  time  pressure 
induced  by  a  large  workload  appears  to  negatively  impact  decision  accuracy. 
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The  final  two-way  interaction  obtained  for  accuracy  was  a  marginally  significant  interaction 
between  workload  and  evaluation  expectancy  (Fi,223=2.23,  p=.14,  t|p2=.01).  Consistent  with  results  for 
response  consistency,  accuracy  was  significantly  lower  for  decisions  made  in  low  workload  conditions 
with  high  evaluation  expectancy  (M=.66,  sd=.12)  as  opposed  to  those  where  both  workload  and 
evaluation  expectancy  were  low  (M=. 70,  sd=.12),  further  supporting  the  idea  that  evaluation  may  cause 
stress  that  can  inhibit  performance.  Moreover,  the  stress  may  be  alleviated  to  some  extent  with  practice 
and  the  emergence  of  feelings  of  confidence.  Thus,  in  high  workload  conditions,  there  was  no  significant 
difference  in  decision  accuracy  between  decisions  made  under  conditions  of  high  (M=.57,  sd=.l  1)  versus 
low  evaluation  expectancy  (M=.58,  sd=. 09). 

Timeliness.  Based  on  the  results  presented  in  Table  5,  the  average  amount  of  time  spent  on  each 
case  was  significantly  related  to  verbal  intelligence  (Fi,223=4.79,  p=.03,  t|p2=.02),  where  individuals 
exhibiting  better  verbal  reasoning  abilities  took  less  time,  on  average,  to  complete  each  case.  This  is 
hardly  surprising  given  the  relationship  between  intelligence  and  information  processing  (Hunt,  1978; 
Jackson  &  McClelland,  1979;  Kranzler  &  Jensen,  1989).  Significant  main  effects  for  evaluation 
expectancy  (FU23=3.97,  p=.05,  t|p2=.02),  risk  (F1>223=83.54,  pc.OOl,  r|p2=.27),  and  workload  (F]j223=90.93, 
p<.001,  t|p2=.29)  were  found.  Hypothesis  Two  was  partially  supported  in  that  judgment  intent  was  not  a 
significant  main  effect  for  timeliness. 

First,  decision-makers  in  low  evaluation  expectancy  conditions  made  more  timely  decisions 
(M=4.81  minutes,  sd=1.26)  than  those  with  high  evaluation  expectancy  (M=5.09,  sd=1.61).  This  result  is 
consistent  with  Hypothesis  Three  for  timeliness.  Evaluation  expectancy  influences,  however,  were 
moderated  by  workload  in  a  significant  two-way  interaction  (Fi  ,223=12.38,  p<.001,  tip2=. 05).  When 
workload  was  low,  decision-makers  with  low  evaluation  expectations  made  more  timely  decisions 
(M=5.20,  sd=1.40)  than  those  with  high  evaluation  expectations  (M=6.00,  sd=1.65).  The  aforementioned 
stress  association  with  evaluative  pressures  may  cause  people  to  take  more  time  to  make  decisions 
because  they  are  concerned  with  the  decision  justification  evaluation  versus  the  actual  decision.  When 
workload  was  high,  however,  the  low  evaluation  expectancy  condition  produced  less  timely  decisions 
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(M=4.42,  sd=.95)  than  the  high  evaluation  expectancy  condition  (M=4.18,  sd=. 95).  Again,  the  feelings  of 
competence  induced  by  practice  seem  to  alleviate  stress  induced  by  the  expectation  of  evaluation  and 
allow  decision-makers  to  work  more  quickly. 

A  significant  three-way  interaction  was  also  obtained  between  evaluation  expectancy,  judgment 
intent,  and  risk  (Fij223=4.10,  p=.04,  tiP2=.  02).  In  all  cases,  decision-makers  in  high  risk  conditions  took 
significantly  more  time  to  make  security  decisions  (M=5.57,  sd=l  .48)  than  those  in  low  risk  conditions 
(M=4.32,  sd=1.05).  When  situational  risk  was  low  and  developmental  judgments  were  emphasized,  there 


Table  5.  Analysis  of  Covariance  of  Time  as  a  Function  of  Workload,  Risk,  Judgment  Intent,  and 
Evaluation  Expectancy,  With  Verbal  Reasoning  Scores  as  Covariate _ _ _ 


Source 

df 

MS 

F 

£ 

„  2 
Bn 

Verbal  Intelligence 

1 

5.391 

4.79 

.03 

.02 

Judgment  Intent  (JI) 

1 

.055 

.05 

.83 

.00 

Evaluation  Expectation  (EE) 

1 

4.469 

3.97 

.05 

.02 

Workload  (W) 

1 

102.314 

90.93 

.00 

.29 

Risk  (R) 

1 

93.996 

83.54 

.00 

.27 

W  xR 

1 

16.114 

14.32 

.00 

.06 

W  x  JI 

1 

.672 

.60 

.44 

.00 

W  x  EE 

1 

13.926 

12.38 

.00 

.05 

Rx  JI 

1 

.595 

.53 

.47 

.00 

Rx  EE 

1 

.707 

.63 

.43 

.00 

JI  x  EE 

1 

1.336 

1.19 

.28 

.01 

WxRx  JI 

1 

.719 

.64 

.43 

.00 

W  x  R  x  EE 

1 

.357 

.32 

.57 

.00 

W  x  JI  x  EE 

1 

2.888 

2.57 

.11 

.01 

R  x  JI  x  EE 

1 

4.607 

4.10 

.04 

.02 

W  x  R  x  JI  x  EE 

1 

.063 

.06 

.81 

.00 

Error 

223 

1.125 

Total 

239 

2.100 
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were  no  substantial  differences  between  individuals  in  low  evaluation  expectancy  (M=4.35,  sd=l  .09)  and 
high  evaluation  expectancy  (M=4.40,  sd=1.25)  conditions.  Again,  there  was  no  significant  difference  in 
timeliness  between  decision-makers  with  low  evaluation  expectancies  (M=4.1 1,  sd=.88)  and  high 
evaluation  expectancies  (M=4.43,  sd=.98)  in  low  risk  conditions  where  a  judgment  was  based  on  the 
guidelines.  In  high  risk  conditions  where  the  judgment  intent  was  developmental,  however,  decision¬ 
makers  with  high  evaluation  expectancy  took  significantly  more  time  to  make  security  decisions 
(M=5.90,  sd=l  .74)  compared  to  individuals  with  low  evaluation  expectancy  (M=5.10,  sd=1.12).  There 
was  no  significant  difference  between  decision  timeliness  in  high  evaluation  expectancy  (M=5.62, 
sd=l  .29)  and  low  evaluation  expectancy  (M=5.67,  sd=l  .29)  conditions  in  which  situation  risk  was  high 
and  a  guideline-driven  approach  to  judgment  was  established. 

These  results  provide  partial  support  for  Hypothesis  Three  in  that  decision-makers  in  high 
evaluation  expectancy  conditions  made  less  timely  decisions  than  those  with  a  low  expectation  for 
evaluation  when  negative  consequences  were  likely  and  when  decision-makers  were  unsure  of  what 
information  should  be  used  and  to  satisfy  evaluators.  However,  when  evaluation  expectancy  was  low, 
decision-makers  didn’t  appear  to  worry  as  much  about  risk,  or  negative  consequences,  because  they  did 
not  expect  their  work  to  be  evaluated,  and  therefore  took  less  time.  These  effects  are  not  seen  in 
guideline-driven  judgment  conditions,  likely  because  decision-makers  have  clear  guidelines  concerning 
necessary  information,  thereby  allowing  efficient  information  search  and  structuring  activities. 

Along  with  evaluation  expectancy,  risk  and  workload  had  significant  main  effects  on  decision 
timeliness.  Specifically,  decision-makers  in  high  risk  situations  made  less  timely  decisions  (M=5.58, 
sd=l  .52)  than  those  in  low  risk  situations  (M=4.32,  sd=1.05),  while  decision-makers  with  higher 
workloads  made  much  more  timely  decisions  (M=4.3 1,  sd=l  .94)  than  those  with  low  workloads  (M=5.60, 
sd=l  .57).  Consistent  with  results  for  decision  accuracy,  risk  and  workload  interacted  with  one  another  to 
influence  decision  timeliness  (Fi  14.32.  p<.00 1 ,  t|p2=.06).  Particularly,  in  low  risk  conditions, 
decisions  took  more  time  per  case  when  workload  was  low  (M=4.71,  sd=l .  13)  than  when  workload  was 
high  (M=3.94,  sd=.82).  The  same  pattern  is  observed  in  high  risk  conditions,  where  decisions  made  under 
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a  lighter  workload  took  significantly  more  time  to  make  (M=6.48,  sd=l  .46)  than  decisions  made  when 
workload  was  high  (M=4.67,  sd=.92).  It  is  noteworthy  that  decision-makers  who  understood  the  potential 
for  negative  consequences  and  had  ample  time  to  allow  for  decision-making  took  the  most  time  to  make 
and  justify  security  decisions,  and  they  also  made  more  accurate  decisions.  Additionally,  when  no 
negative  consequences  were  likely  and  time  was  pressing,  decision-makers  who  took  the  least  time  to 
make  decisions  were  also  the  least  accurate  and  consistent  decision-makers. 

Finally,  a  marginally  significant  three-way  interaction  between  judgment  intent,  evaluation 
expectancy,  and  workload  (Fi  223=2.57,  p=.l  1,  qp2=.01)  was  obtained.  Overall,  decision-makers  in  high 
evaluation  expectancy  conditions  made  less  timely  decisions  than  those  with  a  low  expectation  for 
evaluation  when  workload  was  low  and  when  decision-makers  were  unsure  of  what  information  should  be 
used  to  satisfy  evaluators.  In  conditions  where  judgments  were  guideline-driven,  decision-makers  were 
confident  about  the  information  that  is  most  important  in  justifying  their  decisions,  evaluation  expectancy 
effects  are  not  seen  and  decision-makers  make  more  timely  decisions.  More  specifically,  decision-makers 
in  high  workload  conditions  took  consistently  less  time  to  complete  each  case  (M=4.3 1,  sd=.94)  than 
those  in  low  workload  conditions  (M=5.59,  sd=l  .52).  When  workload  was  high,  there  was  no  significant 
different  between  decision-makers  in  developmental  climates  with  high  evaluation  expectancy  (M=4.08, 
sd=1.06)  and  low  evaluation  expectancy  (M=4.40,  sd=.96),  or  between  decision-makers  in  climates  where 
judgment  was  guideline-driven  with  high  (M=4.28,  sd=.76)  and  low  (M=4.44,  sd-.96)  evaluation 
expectancy.  In  low  workload  conditions  in  which  the  organization  values  developmental  judgments, 
decision-makers  with  high  evaluation  expectancy  took  significantly  more  time  to  make  security  decisions 
(M=6.22,  sd=l .5 1 )  than  those  who  did  not  expect  to  be  evaluated  (M=5.05,  sd=l  .27).  In  low  workload 
conditions  where  guideline-driven  judgment  was  valued,  there  was  little  difference  between  decision¬ 
makers  with  high  evaluation  expectancy  (M=5.77,  sd=l  .78)  and  low  evaluation  expectancy  (M=5.34, 
sd=l  .54)  in  the  average  time  taken  to  evaluate  each  case.  Again,  these  results  provide  support  for 
Hypothesis  Three. 
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Quality.  As  Table  6  shows,  none  of  the  three  covariate  measures  used  in  this  study  produced 
significant  main  effects  on  response  quality.  ANOVA  results  revealed  support  for  Hypothesis  two  in  that 
judgment  intent  also  had  no  effect  on  response  quality.  Evaluation  expectancy  had  only  a  marginally 
significant  main  effect  (Fi;224=2.50,  p=.12,  r|p2=.01)  on  response  quality  in  that  decisions  makers  under 
conditions  of  high  evaluation  expectancy  produced  more  coherent,  or  higher  quality,  justifications  for 
their  decisions  (M=3.73,  sd=.69)  than  when  evaluation  was  not  expected  (M=3.60,  sd=.69).  The  full 
effects  of  evaluation  expectancy,  however,  are  better  reflected  in  a  set  of  two-  and  three-way  interactions 
between  evaluation  expectancy  and  risk  and  workload.  First,  quality  responses  with  high  and  low 
evaluation  expectancy  tend  to  vary  dependent  on  situational  risk  (Fi  224=6.99,  p=.01,  t|p2=03).  In  low  risk 
conditions,  decision-makers  who  expected  to  be  evaluated  gave  higher  quality  responses  (M=3.57, 
sd=.75)  than  decision-makers  who  did  not  expect  to  be  evaluated  (M=3.23,  sd=.56).  This  indicates  that 
decision-makers  who  expected  to  be  evaluated  were  careful  to  provide  coherent  and  appropriately  worded 
responses.  In  high  risk  situations,  there  was  little  difference  in  response  quality  between  high  (M=3.88, 
sd=.59)  and  low  (M=3.97,  sd=.61)  evaluation  expectancy.  One  explanation  for  this  pattern  of  effects  is 
that  the  need  to  minimize  risk  shifts  attention  from  evaluation  to  decision  analysis.  A  significant  main 
effect  was  also  found  for  situational  risk  (Fl  224=41.37,  p<.001,  t|p2=.16)  where  decision-makers  in  high 
risk  conditions  gave  higher  quality  responses  (M=3.92,  sd=.60)  than  those  in  low  risk  conditions 
(M=3.39,  sd=.68).  This  finding  is  consistent  with  Hypothesis  Four. 

In  a  significant  three-way  interaction,  risk  and  workload  significantly  interact  with  judgment 
intent  (F1224=4.51,  p=.04,  t|p2=.02)  to  influence  decision  quality.  The  effect  of  risk  is  particularly  strong, 
with  significant  differences  between  quality  responses  in  high  risk  and  low  risk  situations  occurring  at 
each  level  of  workload  and  judgment  intent.  More  specifically,  when  workload  was  low  and  judgment 
intent  was  developmental,  low  risk  situations  resulted  in  lower  quality  responses  (M=3.46,  sd=.61)  than 
high  risk  situations  (M=3.77,  sd=.63).  When  workload  was  low  and  judgment  was  driven  by  the 
guidelines,  decisions  were  more  coherent  in  high  risk  conditions  (M=4.01,  sd=.68)  and  less  so  when 
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Table  6.  Analysis  of  Variance  Results  for  Main  Effects  and  Interaction  Effects  of  Workload, 
Risk,  Judgment  Intent,  and  Evaluation  Expectancy  on  Quality  Scores _ 


Source _ df _ MS _ £ _ g _ 


Judgment  Intent  (JI) 

1 

.605 

1.52 

.22 

.01 

Evaluation  Expectation  (EE) 

1 

.996 

2.50 

.12 

.01 

Workload  (W) 

1 

.086 

.22 

.64 

.00 

Risk  (R) 

1 

16.467 

41.37 

.00 

.16 

W  xR 

1 

.032 

.08 

.78 

.00 

W  x  JI 

1 

.108 

.27 

.60 

.00 

W  x  EE 

1 

.023 

.06 

.81 

.00 

Rx  JI 

1 

.008 

.02 

.88 

.00 

R  x  EE 

1 

2.783 

6.99 

.01 

.03 

JI  x  EE 

1 

.603 

1.52 

.22 

.01 

WxRxJI 

1 

1.797 

4.51 

.04 

.02 

W  x  R  x  EE 

1 

1.203 

3.02 

.08 

.01 

W  x  JIx  EE 

1 

.069 

.17 

.68 

.00 

R  x  JI  x  EE 

1 

.500 

.13 

.26 

.01 

WxRxJIxEE 

1 

.002 

.01 

.94 

.00 

Error 

224 

.396 

Total 

239 

.479 

situational  risk  was  low  (M=3.33,  sd=. 77).  The  same  pattern  is  seen  when  workload  is  high  and  judgment 
intent  is  developmental  (Mhjghrisk=3.96,  sd=. 53;  Miowrisk=3.25,  sd=. 69)  or  when  judgment  is  guideline- 
driven  (Mhighrisk=3.94,  sd=.54;  Mlowrisk=3.56,  sd=. 64).  These  results  indicate  a  strong  desire  to  avoid 
negative  consequences  that  is  especially  salient  when  time  is  available  to  provide  high  quality,  coherent 
decision  justification  and  when  clear  expectations  regarding  response  content  have  been  established. 

Finally,  a  marginally  significant  three-way  interaction  was  found  between  risk,  workload  and 
evaluation  expectancy  (Fi;224=3.02,  p=.08,  qp2=.01).  Again,  in  all  cases,  high  risk  produced  higher  quality 
responses  than  low  risk.  In  low  risk/low  workload,  decision-makers  with  high  evaluation  expectancy 
provided  only  slightly  higher  quality  responses  (M=3.50,  sd=.74)  than  decision-makers  with  low 
evaluation  expectancy  (M=3.28,  sd=.64).  A  similar  pattern  emerged  for  high  risk/low  workload 
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conditions  where  high  evaluation  expectancy  (M=3.94,  sd=.67)  resulted  in  no  significant  difference  in 
response  quality  from  low  evaluation  expectancy  (M=3.86,  sd=. 67).  In  low  risk  situations  where 
workload  was  high,  high  evaluation  expectancy  produced  significantly  higher  quality  responses  (M=3.64, 
sd=.76)  than  low  evaluation  expectancy  (M=3.17,  sd=.48),  while  in  high  risk/high  workload  conditions, 
no  significant  difference  in  response  quality  was  observed  between  high  (M=3.83,  sd=.50)  and  low 
(M=4.08,  sd=55)  evaluation  expectancy.  These  results  indicate  that  when  risk  is  high,  response  quality  is 
consistently  high  in  the  attempt  to  avoid  negative  outcomes.  When  risk  is  low,  however,  and  negative 
outcomes  are  unlikely,  practice  effects  stemming  from  increased  workload  may  somewhat  increase  the 
decision-makers  ability  to  provide  coherent  justifications  of  their  decisions,  although  responses  remain 
mediocre. 

Discussion 

This  study  revealed  several  findings  that  provide  both  theoretical  and  practical  implications  for 
case-based  managerial  decision-making  under  specific  organizational  and  situational  conditions.  Prior  to 
expanding  on  these  implications,  however,  it  is  necessary  to  address  the  limitations  of  the  current  study. 
First,  the  use  of  undergraduate  psychology  students  in  place  of  trained  adjudicators  may  be  cause  for 
some  concern  regarding  the  generalizability  of  results  to  a  managerial  or  security  adjudicator  population. 
Particularly,  adjudicators  in  “real  life”  CAFs  have  a  common  background  regarding  the  culture  and 
climate  of  the  CAF,  the  necessity  of  solid  and  well-thought  decisions,  and  the  ways  that  poor  decisions 
can  adversely  affect  national  security.  This  concern  is  somewhat  mitigated,  however,  in  that  all 
participants  were  provided  with  a  common  background  of  the  organization  for  which  they  were  making 
decisions  along  with  the  rationale  for  why  this  task  was  vital  to  the  organization’s  security.  Additionally, 
all  information  was  presented  immediately  prior  to  the  file  review  and  decision-making  task  so  that  it  was 
fresh  in  the  minds  of  the  decision-makers  as  they  completed  the  decision  task.  The  primary  goal  of  the 
current  study  was  to  examine  how  specific  organizational  factors  and  task  demands  could  influence  case- 
file  review,  the  use  of  vital  security-related  information,  and  subsequent  security  decisions.  The  findings 
obtained  with  the  undergraduate  sample  provide  us  with  a  general  idea  of  how  these  factors  can  influence 
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decision-making.  Results  provide  the  necessary  evidence  that  organizational  and  task-demand  factors  do, 
in  deed,  influence  file  review  and  decision-making  processes  and  they  also  help  establish  an  experimental 
foundation  for  carrying  out  similar  studies  in  adjudication  settings  with  actual  personnel  security 
adjudicators. 

Next,  although  the  file  review  and  decision-making  task  used  in  this  study  was  considered  to  be 
realistic  by  our  expert  reviewers,  these  cases  were  not  as  complex  as  cases  seen  in  actual  personnel 
security  adjudications.  This  limitation,  however,  does  not  pose  a  critical  threat  to  the  current  study 
because  several  organizational  factors  and  task-demand  characteristics  were  found  to  influence  case 
review  and  decision-making  even  when  cases  were  relatively  simple  and  unambiguous.  It  is  interesting  to 
observe  that  these  factors,  particularly  those  that  appear  to  influence  cognitive  executive  functioning,  can 
influence  decision-making  even  when  the  information  provided  is  straightforward.  Accordingly,  it  makes 
sense  that  as  cases  become  more  complex  and  ambiguous,  and  therefore  require  more  cognitive  capacity 
to  process,  that  these  factors  would  have  an  even  greater  influence  on  decision-making  capabilities. 

A  third  limitation  relates  to  the  setting  in  which  the  current  study  took  place.  All  case-file  reviews 
were  conducted  in  highly-controlled,  classroom  settings.  There  were  no  more  than  thirty  individuals  in  the 
room  at  a  time  and  all  decision-makers  were  reviewing  the  same  set  of  cases.  As  opposed  to  “real  life” 
settings,  decision-makers  were  not  interrupted  by  telephone  calls,  e-mails,  coworkers,  or  other  things  that 
are  typically  experienced  in  a  CAF  setting  that  may  interact  with  organizational  and  situational  factors  to 
influence  decision  consistency,  accuracy,  timeliness,  and  quality.  In  fact,  because  the  proposed 
organizational  and  task-demand  characteristics  did  appear  to  influence  decisions  in  a  controlled  setting, 
we  believe  that  these  influences  may  be  exacerbated  by  the  daily  stresses  encountered  in  actual  personnel 
security  adjudication  settings. 

Several  broad  findings  emerged  regarding  the  influence  of  judgment  intent,  evaluation 
expectancy,  situational  risk,  and  workload  on  decision  consistency,  accuracy,  timeliness,  and  quality. 
These  findings  can  be  used  to  provide  answers  to  our  five  fundamental  research  questions. 
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Question  One:  How  can  organizational  factors,  specifically  judgment  intent  and  evaluation 
expectation,  influence  consistent  use  of  decision  rules,  overall  accuracy  and  quality  of  decisions,  and 
timeliness  with  which  decisions  are  made  across  CAFs?  Particularly,  Hypothesis  One,  that 
judgment  not  based  on  the  guidelines  (developmental  judgment  intent)  would  be  detrimental  to  decision 
consistency  and  accuracy,  was  partially  supported.  Decision-makers  working  in  cultures  espousing 
guideline-driven  judgment  made  more  consistent  decisions  than  those  where  guidelines  were  not 
emphasized.  Accuracy,  however,  was  not  influence  by  judgment  intent.  Hypothesis  Two,  that  judgment 
intent  would  have  no  effect  on  timeliness  or  decision  quality  was  supported.  Thus,  it  appears  that  focus  on 
guidelines  does  not  influence  the  amount  of  time  decision-makers  are  willing  to  allocate  to  the  case-file 
review  nor  does  it  influence  the  coherent  quality  of  decision  justification. 

The  hypothesis  that  high  evaluation  expectancy  would  increase  consistency,  accuracy,  and  quality 
and  decrease  timeliness,  Hypothesis  Three,  was  partially  supported.  Individuals  with  high  expectation  of 
evaluation  did  take  more  time  to  review  cases  and  to  make  decisions  and  provided  the  most  coherent 
justifications  of  their  decisions.  However,  when  evaluation  was  expected,  decision  consistency  and 
accuracy  suffered,  particularly  in  settings  where  the  judgment  intent  was  not  guideline-driven,  and  when 
the  risk  involved  in  the  task  was  not  readily  apparent  to  decision-makers.  These  findings  indicate  that 
evaluation  may  not  be  good  for  decision-makers,  especially  in  developmental ly-focused  settings  where 
ambiguity  exists  regarding  the  importance  of  each  piece  of  information  presented  in  the  case. 

Additionally,  evaluation  expectation  may  be  detrimental  when  there  is  nothing  to  offset  the  stress  caused 
by  anticipation  of  the  evaluation,  such  as  practice  or  focus  on  the  risk  involved  in  the  decision.  Therefore, 
evaluation  expectancy  can  be  particularly  dangerous  in  low-risk  conditions,  where  the  need  to  make  good 
decisions  is  not  evident,  because  the  evaluation  itself  becomes  the  focus  of  decision-making,  as  opposed 
to  the  actual  security  decision. 

Question  Two:  How  can  risk,  or  security  level  of  case,  and  workload  influence  decision 
accuracy,  consistent  use  of  decision  rules,  overall  quality  of  decisions,  and  timeliness  with  which 
decisions  are  made  within  a  CAF?  Results  provided  full  support  for  Hypothesis  Four,  in  that 
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decision-makers  who  were  aware  of  the  risk  involved  in  the  decision-making  task  made  more  consistent, 
more  accurate,  less  timely,  and  higher  quality  decisions.  Decision-makers  put  great  effort  into  thoroughly 
reviewing  each  case  in  order  to  avoid  making  bad  decisions  and  subsequently  avoid  possible  negative 
consequences.  Furthermore,  it  appears  that  risk  may  have  been  the  single-most  important  factor  to  focus 
decision-makers  on  the  importance  of  using  the  employment  guidelines. 

Finally,  Flypothesis  Five,  was  supported  for  accuracy  (high  workload  lead  to  less  accurate 
decisions),  and  for  timeliness  (high  workload  lead  to  faster  file  review),  but  was  not  supported  for 
consistency  and  quality.  The  inverse  to  Hypothesis  Five  actually  occurred  with  high  workload  leading  to 
more  consistent  and  higher  quality  decisions.  Although  we  expected  high  workload  to  exert  time  pressure 
that  would  interfere  with  information  processing,  high  workload  appears  to  have  acted  as  practice, 
therefore  increasing  response  consistency  and  quality.  The  more  cases  decision-makers  reviewed,  the 
more  familiar  they  seemed  to  become  with  coherently  justifying  decisions  using  the  employment 
guidelines.  Thus,  time  pressure  was  present,  as  seen  in  time  spent  per  case  in  high  workload  conditions, 
but  was  offset  by  the  confidence  decision-makers  gained  as  they  became  more  proficient  at  analyzing  and 
evaluating  case  information. 

Question  Three:  Which  organizational  and  situational  factors  appear  to  exert  the  most 
influence  on  consistency  with  the  adjudicative  guidelines?  Results  of  the  current  effort  show  that 
both  the  organizational  factor,  judgment  intent,  and  the  situational  factor,  risk,  are  key  to  adjudicative 
decisions  that  are  consistent  with  the  adjudicative  guidelines.  Particularly,  individuals  in  environments 
that  support  strong  adherence  to  the  guidelines  also  made  decisions  that  were  the  most  consistent  with 
them.  This  is  a  logical  and  expected  finding  in  that  when  the  use  of  guidelines  is  emphasized  and  made 
salient  to  adjudicators,  they  are  likely  to  pay  closer  attention  to  how  material  presented  in  each  case  is 
addressed  in  the  guidelines.  Situational  risk  also  influences  decision  consistency.  When  the  likelihood  for 
negative  consequences  is  high,  adjudicators  are  much  more  careful  to  use  the  guidelines  as  the  basis  for 
their  decisions  than  they  are  when  negative  consequences  are  not  a  threat. 
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Question  Four:  How  does  the  expectation  of  evaluation  influence  quality  of  security 
clearance  decisions?  Quality,  as  defined  in  this  study,  refers  to  the  decision-maker’s  ability  to  provide 
a  coherent  and  rational  justification  for  his  or  her  decision.  Expectation  of  evaluation,  however,  had  no 
singular  effect  on  decision  rationale.  When  situational  risk  was  considered,  however,  evaluation 
expectation  is  important.  When  risk  is  low,  and  therefore  negative  consequences  are  not  expected,  the 
likelihood  of  being  evaluated  leads  to  higher  quality  responses. 

Even  more  important  to  the  broad  implications  of  this  study,  however,  is  a  more  far-reaching 
definition  of  quality  adjudications,  one  that  encompasses  accuracy,  consistency,  and  the  ability  to 
adequately  defend  a  clearance  decision.  Expectation  of  evaluation,  in  this  case,  was  very  important  to 
adjudication  quality  in  several  ways  that  are  presented  in  more  detail  later  in  this  report.  Most  notably, 
however,  the  expectation  of  evaluation  lead  to  low  quality  decisions  if  it  is  not  handled  appropriately. 

Question  Five:  How  can  organizational  and  situational  factors  influence  decision 
reciprocity?  Historically,  CAFs  have  demonstrated  variations  in  work  environments  and 
organizational  conditions.  The  concern  that  these  variations  may  lead  to  low  reciprocity  of  adjudication 
decisions  between  CAFs  was  upheld  by  this  study.  Even  in  a  highly  controlled  experimental  setting,  we 
see  that  organizational  and  situational  factors  played  a  key  role  in  the  application  of  the  adjudicative 
guidelines  as  well  as  decision  accuracy.  It  seems  safe  to  assume  that,  because  the  notion  of  reciprocity  is 
based  on  uniform  application  of  the  guidelines  that  will  lead  to  accurate  decisions  across  CAFs,  marked 
differences  in  consistency  and  accuracy  seen  under  different  conditions  is  reflective  of  poor  reciprocity. 
Therefore,  in  current  CAF  conditions,  it  should  be  expected  that  personnel  security  clearances  granted  by 
one  CAF  are,  in  fact,  not  reciprocal  with  another. 

Theoretical  Implications 

Often  times  the  notion  of  decision-making  is  approached  in  the  literature  as  a  relatively  simple  or 
low-complexity  task  involving  a  choice  between  a  number  of  alternatives.  For  example,  managerial 
decision-making  may  be  studied  in  the  sense  of  making  “yes/no”  hiring  decisions  based  on  a  single  source 
of  information  where  decision-makers  review  the  information  to  determine  hiring  eligibility.  These 
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studies  are  useful  because  it  is  easier  to  study  specific  decision-making  behaviors  when  examining  the 
effects  of  only  one  source  of  information  versus  a  variety  of  information  types  from  different  sources 
(Massaro  &  Friedman,  1990).  Most  managerial  decisions,  however,  including  the  personnel  security 
decisions,  involve  significantly  more  complex  information  integration  than  that  described  in  the  above 
example  (Hitt  &  Barr,  1989).  In  particular,  adjudicators  are  expected  to  review  a  case-file  consisting  of  a 
variety  of  information  from  a  large  number  of  different  sources  and  to  consider  how  each  piece  of 
information  in  that  file  is  applicable  to  the  security  decision  at  hand. 

Results  of  the  current  study  provide  several  theoretical  implications  regarding  organizational  and 
situational  influences  on  such  complex  decisions.  First,  when  making  complex  decisions,  decision-makers 
must  be  focused  on  the  actual  decision-making  task.  When  conditions  are  conducive  to  drawing  attention 
away  from  the  task,  decisions  suffer.  Particularly,  when  decision-makers  believe  the  task  to  be  relatively 
unimportant,  decisions  are  not  as  good  as  when  focus  is  directed  to  the  importance  of  the  decision. 
Moreover,  in  organizations  where  evaluation  is  likely  to  occur,  it  is  easy  for  decision-makers  to  become 
cognitively  focused  on  the  evaluation,  or  pleasing  evaluators,  rather  than  on  the  ultimate  decisions  they 
are  making  (Bell,  1982).  Therefore,  it  is  necessary  to  direct  decision-makers’  focus  on  the  decision  task 
before  it  begins,  most  ideally  during  training. 

Accordingly,  decision-makers  need  to  have  a  clear  idea  of  the  exact  information  in  each  case-file 
to  focus  on  when  making  decisions.  When  guidance  is  not  provided  concerning  the  relative  importance  of 
various  pieces  of  information,  decision-makers  experience  cognitive  ambiguity  and  are  more  likely  to 
focus  on  irrelevant  information  (Hitt  &  Barr,  1989).  As  seen  in  the  current  study,  a  focus  on  employee 
development  leads  to  decisions  that  are  less  accurate  and  less  consistent  with  employment  guidelines.  In 
organizations  where  decision-makers  are  instructed  to  use  employment  guidelines  to  make  decisions, 
however,  decision-makers  make  more  focused  decisions  and  are  better  able  to  justify  their  decisions. 

The  ability  to  focus  both  on  the  decision-making  task  and  relevant  case-file  information  may  be 
best  obtained  through  training  and  practice.  As  results  clearly  show,  practice  that  occurs  with  increased 
workload  leads  to  more  consistent  and  higher  quality  decisions,  indicating  that  practice  increases  focus  on 
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appropriate  case-file  information.  Decisions  may  be  best  served  through  realistic  practice  based  on  1) 
example  cases  and  2)  the  specific  decision  process  that  should  be  carried  out  (Cheng,  Holyoak,  Nisbett  & 
Oliver,  1986).  Although  a  single  practice  case  was  used  for  training  in  the  current  study,  it  was  presented 
as  an  example  of  the  information  that  might  be  available  for  each  case  along  with  examples  of  correct  and 
incorrect  answers  to  security  questions.  Much  more  extensive  practice  with  the  actual  decision  process, 
however,  as  seen  with  increased  workload,  is  needed  before  decisions  reflect  accurate  application  of 
employment  guidelines  and  before  decisions  are  made  based  on  the  most  relevant  pieces  of  information 
presented  in  each  case.  Practice  clarifies  the  decision  process  and  may  reduce  the  overall  complexity  of 
the  decision-making  task  by  providing  procedural  guidance  for  using  decision-rules  in  HR  decisions. 

The  results  of  the  current  study  point  out  that  is  difficult,  if  not  impossible,  to  create  a  working 
environment  in  which  case-based  decisions  are  always  optimal.  Decisions  are  often  based  on  individual, 
as  opposed  to  organizational,  concerns,  whereas  poor  decisions  may  lead  to  negative  consequences  for 
both  the  organization  and  the  individual  decision-maker.  It  is  necessary  for  decision-makers  to  understand 
all  possible  negative  consequences,  and  it  is  particularly  important  for  them  to  understand  the  personal 
effects  of  bad  decisions.  When  individuals  are  working  toward  personally  relevant  goals,  decision-making 
performance  seems  to  increase  (Brown  &  Latham,  2002).  Situational  risk  and  organizational  focus  on 
evaluation  are  particularly  important  constructs  in  regard  to  identifying  individual-level  consequences. 
When  situational  risk  is  low,  decision-makers  tend  to  make  consistently  poor  decisions.  This  is  especially 
true  when  time  is  pressing  and  when  evaluation  is  not  a  concern.  Decision-makers  who  have  nothing  to 
lose,  and  know  that  no  one  will  be  checking  their  work,  make  low  quality,  inconsistent  decisions. 

Thus,  decisions  with  some  level  of  risk  attached  to  them  may  have  value  for  overall  decision 
consistency,  accuracy,  and  quality,  so  long  as  support  is  provided  for  managing  that  risk.  It  is  well 
understood  that  individuals  prefer  to  avoid  risky  situations  (Larrick,  1993;  Tversky  &  Kahneman,  1988). 
When  they  cannot,  however,  they  will  attempt  to  avoid  negative  outcomes  by  making  decisions  that  lead 
to  positive  outcomes  (Larrick,  1993).  High  risk  is  likely  to  lead  to  particularly  good  decisions  when 
workload  is  low  and  when  the  organization  values  guideline-driven  judgment.  More  precisely,  risk  may 
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be  especially  conducive  to  decision-making  when  necessary  decision-making  time  is  available  and  when 
guidance  has  been  provided  regarding  the  most  vital  decision  information. 

Finally,  as  noted  above,  evaluation  may  be  detrimental  if  adequate  focus  on  the  decision-making 
task  is  not  provided.  On  the  other  hand,  evaluation  may  be  very  beneficial  to  decision-making, 
particularly  when  attention  is  centered  on  important  pieces  of  information,  when  risk  is  high  enough  to 
provide  focus  on  the  decision  instead  of  the  evaluation,  and  when  adequate  time  is  allowed  for  decision¬ 
makers  to  review  all  file  information  and  to  make  good  decisions.  When  these  conditions  are  met,  the 
decision-maker  has  the  opportunity  to  attend  to  both  the  needs  of  the  organization  (as  addressed  by 
situational  risk  and  decision  guidelines)  and  the  expectations  of  evaluators.  When  decision-makers  expect 
to  be  evaluated  the  desire  exists  to  avoid  negative  evaluations  (Bell,  1982;  Josephs,  et.  al.,  1992),  but  they 
can  ensure  positive  evaluations  if  working  conditions  are  favorable  in  terms  of  the  time  and  attention 
needed  by  the  decision-maker.  Most  notably,  evaluation  appears  to  be  a  mixed  blessing;  it  can 
significantly  enhance  decision-making,  but  it  must  be  handled  with  care. 

Implications  for  Personnel  Security  Adjudications 

Based  on  the  overarching  results  of  this  study,  several  practical  considerations  exist  for  personnel 
security  adjudications.  First,  in  order  to  ensure  reliable  file  reviews  and  valid  decisions  based  on 
established  adjudicative  guidelines,  it  is  necessary  to  train  adjudicators  in  several  areas.  Namely, 
adjudicators  need  to  receive  training  regarding  1)  the  broad  utility  behind  the  decisions  being  made,  2)  the 
potential  negative  outcomes  that  for  both  the  individual  adjudicator  and  for  national  security,  should  poor 
decisions  be  made,  3)  the  types  of  case-file  information  that  are  most  relevant  and  useful  for  making  good 
security  decisions,  and  4)  the  processes  through  which  this  information  should  be  analyzed  in  order  to 
reach  a  final,  valid  decision.  Training  should  include  examples  of  good  and  bad  personnel  security 
decisions,  as  well  as  several  practice  adjudications,  so  that  adjudicator  become  accustomed  to  the 
processes  and  procedures  involved  in  security  investigation  file  review  before  they  begin  to  evaluate 


actual  cases. 
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Next,  performance  evaluation  in  personnel  security  adjudications  must  be  applied  carefully. 

When  evaluation  is  not  critical  to  decision  quality  or  the  CAF  cannot  justify  continual  evaluation  it  is  best 
to  lay  aside  decision  evaluation  for  the  sake  of  high-quality,  reliable  case-file  review.  This  is  especially 
true  when  the  CAF’s  culture  emphasizes  the  desire  to  rehabilitate  individual  employees  with  the  hope  of 
establishing  security  clearance  eligibility  in  the  short-term.  In  such  situations,  if  decision  evaluation  is 
absolutely  necessary,  the  CAF  must  be  adamant  about  training  adjudicators  to  follow  specific  case  review 
protocol,  to  identify  case-file  information  that  is  most  relevant  to  the  needs  of  the  organization,  and  to 
ignore  job  irrelevant  information,  even  if  that  information  has  developmental  implications. 

Careful  application  of  evaluation  is  especially  important  in  CAFs  with  highly  regulated  quality 
control  systems.  Careful  steps  should  be  taken  to  ensure  that  quality  control  processes  do  not  disrupt 
personnel  security  adjudication  and  that  adjudicators  do  not  evaluate  unessential  pieces  of  case-file 
information.  Quality  control  efforts  should  be  accompanied  by  high-level  training  regarding  all  aspects  of 
the  file  review  and  decision-making  process,  and  should  focus  on  the  importance  of  reliable  and  valid 
decisions  versus  specific  quality  control  procedures. 

When  adjudicators  use  personal  histories  to  make  personnel  security  decisions,  it  is  important  to 
make  certain  that  they  are  only  granting  security  clearance  to  trustworthy  individuals  by  making  the  best 
decisions  possible.  Administrators  and  policy  makers,  then,  must  keep  in  mind  that  certain  CAF 
characteristics,  just  as  judgment  intent  and  evaluation  expectancy,  can  have  significant  and  detrimental 
effects  on  the  reliability  and  validity  of  clearance  decisions  if  they  are  not  monitored  and  measures  are  not 
taken  to  lessen  these  effects.  Task  demands  that  are  placed  on  individual  adjudicator  can  also  influence 
the  overall  quality  of  their  decisions.  Therefore,  CAF  managers  must  be  careful  to  monitor  adjudicators’ 
task  loads  as  well  as  the  risk  involved  in  the  decisions  they  are  making  in  order  to  ensure  that  these  task 
demands  are  allocated  appropriately. 

In  order  to  monitor  and  possibly  control  for  these  organizational  and  situational  influences,  we 
present  some  future  considerations  for  ensuring  overall  quality  in  personnel  security  adjudications.  First, 
the  necessity  exists  for  a  formal  guide  (i.e.  handbook  or  on-line  tutorial)  that  will  allow  systematic 
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decision-making  through  appropriate  and  effective  application  of  the  adjudicative  guidelines.  Such  a 
guide  might  include  specific  steps  for  addressing  each  guideline  as  well  as  additional  questions  that  an 
adjudicator  can  ask  in  order  to  ensure  that  all  decisions  are  made  in  the  interest  of  national  security. 

Second,  it  is  important  that  CAFs  establish  a  regular  (i.e.  weekly,  bi-weekly,  or  monthly)  plan  to 
account  for  and  address  any  problems  and  to  provide  feedback  to  individual  adjudicators.  This  could 
possibly  be  carried  out  under  the  auspices  of  a  mentoring  program,  where  any  evaluation  by  a  senior 
adjudicator  is  positively  addressed  as  a  learning  experience.  Therefore,  the  adjudicator  would  feel  less 
stress  of  evaluation  while  at  the  same  time  receiving  timely  and  accurate  feedback  regarding  his  or  her 
adjudicative  performance. 

A  third  positive  move  may  be  to  incorporate  collaborative  work  teams  into  the  adjudication 
environment.  Teams  can  provide  1)  motivation  to  adjudicators  to  focus  on  their  decisions  and  remain 
accountable  to  other  team  members;  2)  coordination  to  the  adjudicative  process  by  allowing  each  team 
member  to  be  responsible  for  a  specific  component  of  each  case;  and  3)  continual  reiteration  of  the  risk 
involved  in  the  decisions  that  are  being  made.  Team-based  adjudications  may  also  help  to  eliminate 
learned  or  habitual  errors  most  often  made  by  isolated  adjudicators;  other  team  members  bring  the 
knowledge  and  expertise  to  identify  and  correct  these  types  of  errors.  Finally,  in  team  settings, 
adjudicators  are  given  the  opportunity  to  learn  from  one  another,  thereby  increasing  their  knowledge  base, 
expertise,  and  confidence  in  their  ability  to  provide  sound  security  clearance  decisions. 

Next,  it  may  be  beneficial  to  eliminate,  or  at  the  veiy  least  decrease  the  impact  of,  formal 
evaluation  procedures.  Evaluation  may  accurately  be  accomplished  through  less  intrusive  measures,  such 
as  the  previously  described  mentoring  program  and  team-efforts,  or  through  a  peer  review  program.  It  is 
important  that  evaluation  be  addressed  as  a  learning  opportunity  specific  to  a  high  risk  environment. 
Except  in  extreme  cases  of  misconduct,  adjudicators  should  feel  that  the  feedback  they  receive  is  merely 
intended  to  help  them  maintain  their  focus  on  making  decisions  in  accordance  with  the  guidelines  and  in 
the  favor  of  national  security. 
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Fifth,  and  finally,  personnel  security  administrators  should  consider  the  implementation  of  a 
Personnel  Development  Plan  designed  for  adjudication  professionals.  This  plan  should  be  built  based  on 
the  current  security  process  model  and  should  be  used  to  train  adjudicators  on  the  security  process  from 
beginning  to  end.  It  should  include  an  in-depth  training  program  consisting  of  1)  CAF  culture,  climate, 
and  behavioral  expectations;  2)  best  practices  using  actual  examples  of  good  and  bad  security  clearance 
decisions;  and  3)  extensive  and  realistic  practice  opportunities.  Ultimately,  such  a  plan  would  ready 
adjudicators  to  review  each  case  they  received  with  a  full  understanding  of  the  primary  purpose  of  the 
personnel  security  investigation  and  adjudication  processes — protecting  the  security  of  the  United  States 
government  and  people. 
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Appendix  A 
Covariate  Measures 


Need  for  Cognition  Scale 

Please  read  each  statement  carefully.  Using  the  following  scale,  indicate  the  degree  to  which  each 
statement  is  characteristic  of  you: _ _ _ 

12  3  4  5 

not  at  all  not  very  uncertain  somewhat  very  much 

_ like  me _ much  like  me _ like  me _ like  me _ 

_  1 .  I  would  prefer  complex  to  simple  problems. 

I  like  to  have  the  responsibility  of  handling  a  situation  that  requires  a  lot  of 
_  2.  thinking. 

_  3.  Thinking  is  not  my  idea  of  fun. 

I  would  rather  do  something  that  requires  a  little  thought  than  something  that  is  sure 
_ 4.  to  challenge  my  abilities. 

I  try  to  anticipate  and  avoid  situations  where  there  is  a  likely  chance  I  will  have  to 
_  5.  think  in  depth  about  something. 

_  6.  I  find  satisfaction  in  deliberating  hard  and  for  long  hours. 

_  7.  I  only  think  as  hard  as  I  have  to. 

_  8.  I  prefer  to  think  about  small,  daily  projects  to  long-term  ones. 

9.  I  like  tasks  that  require  little  thought  once  I  have  learned  them. 

_  1 0.  The  idea  of  relying  on  thought  to  make  my  way  to  the  top  appeals  to  me. 

11.  I  really  enjoy  a  task  that  involves  coming  up  with  new  solutions  to  problems. 

12.  Learning  new  ways  to  think  doesn’t  excite  me  very  much. 

_  13.  I  prefer  my  life  to  be  filled  with  puzzles  that  I  must  solve. 

_  14.  The  notion  of  thinking  abstractly  is  appealing  to  me. 

I  would  prefer  a  task  that  is  intellectual,  difficult,  and  important  to  one  that  is 
_  1 5.  somewhat  important  but  does  not  require  much  thought. 

I  feel  relief  rather  than  satisfaction  after  completing  a  task  that  required  a  lot  of 
_  16.  mental  effort. 

It’s  enough  for  me  that  something  gets  the  job  done;  I  don’t  care  how  or  why  it 
_  17.  works. 

I  usually  end  up  deliberating  about  issues  even  when  they  do  not  affect  me 
_  18.  personally. 


Cognitive  Flexibility  Scale 


The  following  statements  deal  with  your  beliefs  and  feelings  about  your  own  behaviors.  Read  each 
statement  carefully  and  respond  by  writing  the  number  that  best  represents  your  response  in  the  blank  to 
the  left  of  each  question. 

1  2  3  4  5  6 

strongly  disagree  slightly  slightly  agree  strongly 

_ disagree _ disagree _ agree  _ agree 

_  19.  I  can  communicate  an  idea  in  many  different  ways. 

_  20.  I  avoid  new  and  unusual  situations. 

_  21 .  I  feel  like  I  never  get  to  make  decisions. 

_  22.  I  can  find  workable  solutions  to  seemingly  unsolvable  problems. 

_ 23.  I  seldom  have  choices  when  deciding  how  to  behave. 

_ 24.  I  am  willing  to  work  at  creative  solutions  to  problems. 

_ 25.  In  any  given  situation,  I  am  able  to  act  appropriately. 

_  26.  My  behavior  is  a  result  of  conscious  decisions  that  I  make. 

_ 27.  I  have  many  possible  ways  of  behaving  in  any  given  situation. 

_  28.  I  have  difficulty  using  my  knowledge  on  a  given  topic  in  real  life  situations. 

_  29.  I  am  willing  to  listen  and  consider  alternatives  for  handling  a  problem. 

_  30.  I  have  the  self-confidence  necessary  to  try  different  ways  of  behaving. 


EAS  Verbal  Reasoning 


The  following  test  is  a  general  logic  test.  Please  read  the  instructions  for  the  sample  problem 
below,  and  complete  the  following  problems  in  a  similar  fashion.  Please  spend  no  more  than  five  (5) 
minutes  on  these  logic  problems. 

In  the  example  below,  the  facts  say  that  Chris  is  a  widow,  and  that  Company  A  employs  no 
women.  The  fact  that  Chris  is  a  widow  means  that  she  is  a  woman  and  so  could  not  work  for  Company  A, 
which  does  not  hire  women.  Therefore,  the  first  conclusion  is  definitely  true,  and  A  should  be  marked  on 
the  answer  sheet.  The  facts  also  say  that  Chris’  only  child  is  a  girl,  which  means  that  her  son  could  not  be 
ill  since  she  has  no  son.  Therefore,  the  second  conclusion  is  definitely  false,  and  B  should  be  marked  on 
the  answer  sheet.  From  the  facts  that  are  given,  there  is  not  enough  information  to  know  definitely  where 
Chris  works.  She  does  not  work  for  Company  A  because  that  company  hires  no  women.  It  is  possible  that 
she  works  for  Company  C,  but  it  is  also  possible  that  she  works  somewhere  else.  Therefore,  the  third 
conclusion  is  uncertain,  and  C  should  be  marked  on  the  answer  sheet. 

Now  mark  the  two  remaining  conclusions.  “A”  for  true,  “B”  for  false,  and  “C”  for  uncertain. 


FACTS:  Chris  is  a  widow 

Jane  works  for  Co.  B 
Chris’  only  child  is  a  girl 
Co.  A  makes  spark  plugs 
Co.  A  employs  no  women 

CONCLUSIONS: 


1. 

A 

B 

C 

Chris  does  not  work  for  Co.  A 

2. 

A 

B 

C 

Chris’  son  is  ill 

3. 

A 

B 

C 

Chris  works  for  Co.  C 

4. 

A 

B 

C 

Chris  ha  never  been  married 

5. 

A 

B 

C 

Chris  inspects  spark  plugs 

You  should  have  marked  “B”  and  “C”  for  the  fourth  and  fifth  conclusions. 

On  the  next  page  are  six  sets  of  facts  and  six  sets  of  conclusions,  circle  A,  B,  or  C  as  appropriate, 
for  each  conclusion.  When  the  signal  is  given,  turn  the  page  and  begin.  There  are  six  problems 
(sets  of  facts  and  conclusions),  work  them  in  order.  You  will  have  5  minutes,  so  work  as  fast  and 
accurately  as  you  can.  If  you  have  any  questions,  please  ask  them  now. 


Do  Not  Turn  Page  Until  Told  To  Do  So 


FACTS: 


A  =  TRUE 
B  =  FALSE 
C  =  NOT  SURE 


Mr.  J  does  not  smoke 
Mr.  K  and  all  of  his  friends  no  not  smoke 
Mr.  K  is  not  an  aviator 
Mr.  K  has  a  friend  who  is  an  aviator 

CONCLUSIONS: 


ABC 

ABC 

ABC 

ABC 

ABC 


1 .  Mrs.  J  does  not  smoke 

2.  Mrs.  J  is  a  smoker 

3.  All  aviators  smoke 

4.  Some  aviators  smoke 

5.  Mrs.  J  is  an  aviator 


FACTS:  Everyone  living  on  the  farm  is  related  to  Mrs.  Doe 

Hiram  Rogers  has  no  children 
Elias  Biggers  is  Mrs.  Doe’s  brother 
Joseph  Anthony  lives  on  the  farm 
Mrs.  Doe  has  a  son  in  the  Navy 

CONCLUSIONS: 

1 .  Hiram  Ross  lives  on  the  farm 

2.  Joseph  Anthony  is  related  to  Mrs.  Doe 

3.  Elias  Biggers  lives  on  the  farm 

4.  Hiram  Ross  does  not  live  on  the  farm 

5.  Mrs.  Doe  lives  on  the  farm 


ABC 

ABC 

ABC 

ABC 

ABC 


FACTS:  All  houses  on  Elm  Street  are  rented 

McNickel  rents  his  house 
Rafferty  does  not  own  a  home 
Myer  lives  on  Elm  Street 
All  houses  on  Elm  Street  are  modem 

CONCLUSIONS: 

ABC 
ABC 
ABC 
ABC 
ABC 

PLEASE  TURN  TO  THE  NEXT  PAGE 


1 .  Myer  lives  in  a  modem  house 

2.  Rafferty  lives  in  a  farmhouse 

3.  McNickel  lives  on  Elm  Street 

4.  Myer  is  a  good  musician 

5.  Myer  rents  his  house 


FACTS: 


All  of  the  boats  on  Red  River  are  sailboats 
Some  of  Robertson’s  boats  are  on  lake  Bluewater1 


A  =  TRUE 
B  =  FALSE 
C  =  NOT  SURE 


Jones  owns  a  motorboat 

Every  boat  Smith  owns  is  on  Red  River 

Most  of  Robertson’s  boats  are  motorboats 


CONCLUSIONS: 

1 .  Some  of  Robertson’s  boats  are  on  Red  River 

2.  Robertson  has  not  boats  on  Red  River 

3.  Smith  owns  no  sailboats 

4.  Jones  has  no  boats  on  Red  River 

5.  Smith  owns  no  motor  boats 


ABC 

ABC 

ABC 

ABC 

ABC 


FACTS:  The  school  is  bigger  than  the  church 

The  church  is  smaller  than  the  railway  station 
The  railway  station  is  bigger  than  the  post  office 
The  church  is  the  same  size  as  Elks  Hall 


CONCLUSIONS: 

1.  The  Elks  Hall  is  larger  than  the  school 

2.  The  school  and  the  post  office  are  the  same  size 

3.  The  school  is  smaller  than  the  railroad  station 

4.  The  Elks  Hall  is  larger  than  the  post  office 

5.  The  post  office  is  smaller  than  the  Elks  Hall 


ABC 

ABC 

ABC 

ABC 

ABC 


FACTS:  Mary  is  older  than  Jack 

David  is  not  younger  than  Roger 
Jack  is  younger  than  Betty 
Betty  is  not  older  than  Roger 


CONCLUSIONS: 

1 .  Betty  is  not  older  than  Mary 

2.  Jack  is  not  younger  than  David 

3.  Roger  is  not  the  same  age  as  Mary 

4.  Jack  is  not  older  than  Roger 

5.  Betty  is  younger  than  Roger 


ABC 

ABC 

ABC 

ABC 

ABC 


STOP!  YOU  HAVE  COMPLETED  THE  TEST 


Appendix  B 

Task  Description,  Instructions,  and  Organizational  Overview 


Task  Description 


Thank  you  for  agreeing  to  participate  in  this  study.  In  this  study  of  managerial  decision-making, 
your  task  will  be  to  take  on  the  role  of  a  Senior  Security  Manager  for  EAF,  Incorporated,  a  Fortune  500 
company  dealing  primarily  in  oil  and  gas  exploration,  refining,  and  technology. 

As  a  Senior  Security  Manager,  you  will  be  evaluating  a  number  of  employees  for  eligibility  for 
promotion  to  a  newly  developed  and  prestigious  position  within  EAF,  Inc.  The  position  in  question  is  that 
of  Senior  Technology  Representative  (STR).  The  STR  will  serve  as  a  corporate  liaison  between  EAF,  Inc. 
and  its  competitors  and  customers.  He  or  she  will  basically  serve  as  the  eyes  and  ears  for  EAF,  Inc.  to 
developments  in  other  parts  of  the  oil  and  gas  industry  and  to  the  current  technological  needs  of  its 
customers.  This  individual  will  be  expected  to  attend  conventions  and  conferences,  to  meet  and  establish 
working  relationships  with  members  of  various  organizations  representing  the  oil  and  gas  industry,  and  to 
always  be  aware  of  the  newest  technological  advancements  and  innovations. 

Low  Risk  Information 

Because  the  individual  selected  for  this  position  must  be  aware  of  the  latest  technology,  he  or  she 
must  also  be  kept  up-to-date  on  the  technological  developments  happening  at  EAF,  Inc.  These 
developments,  however,  are  often  somewhat  classified  within  EAF,  Inc.,  and  could  represent  a  downfall 
to  the  organization  if  such  information  were  revealed  to  individuals  outside  the  company.  Because  this 
position  is  sensitive  in  nature,  the  individual  chosen  must  be  trustworthy  and  willing  to  uphold  the 
company’s  values. 

High  Risk  Information 

Because  the  individual  selected  for  this  position  must  be  aware  of  the  latest  technology,  he  or  she 
must  also  be  kept  up-to-date  on  the  technological  developments  happening  at  EAF,  Inc.  These 
developments,  however,  are  often  highly  classified  within  EAF,  Inc.,  and  could  represent  a  major 
downfall  to  the  organization  if  such  information  were  revealed  to  individuals  outside  the  company. 
Because  this  position  is  very  sensitive  in  nature,  the  individual  chosen  must  be  trustworthy  and  willing,  at 
all  costs,  to  protect  the  sensitive  knowledge  that  they  have  about  technology  at  EAF,  Inc. 


Therefore,  your  job  is  to  evaluate  several  employees  and  to  determine  if  they  can  be  trusted  with 
company  sensitive  EAF,  Inc.  information. 


Instructions 


As  a  Senior  Security  Manager,  you  will  review  employee  case-files  and  evaluate  whether  an 
employee  can  be  trusted  with  EAF,  Inc.’s  most  sensitive  information. 

First  you  will  be  provided  an  overview  of  FAF,  Inc.,  including  its  history,  goals,  and 
organizational  culture.  Please  read  this  information  carefully  and  try  to  put  yourself  into  the  role  of  a 
Senior  Manager  in  this  company. 

Next,  you  should  read  through  EAF,  Inc.’s  “Guidelines  for  Determining  Eligibility  for  Access  to 
Company  Sensitive  Information.”  These  guidelines  provide  a  set  of  rules  that  might  disqualify  an 
individual  from  eligibility  from  this  position  based  on  past  behaviors  and  activities.  The  guidelines  also 
detail  instances  that  might  mitigate,  or  lessen,  the  negative  effects  of  past  behaviors  and  indicate  times 
where  past  behavior  might  not  influence  eligibility  for  this  position.  Please  read  these  carefully,  and  feel 
free  to  refer  to  them  at  any  time  while  making  your  decisions. 

After  you  have  reviewed  the  organizational  overview  and  the  security  guidelines,  you  will  find 
security  files  for  several  employees  who  are  being  considered  for  the  Senior  Technology  Representative 
position.  Read  through  each  of  these  files  carefully,  considering  all  available  information,  both  positive 
and  negative,  that  might  indicate  that  employee’s  eligibility  for  this  sensitive  position.  You  will  then  be 
asked  to  answer  several  questions  regarding  each  employee’s  eligibility  for  access  to  company  sensitive 
information. 

Specifically,  for  each  individual  case  you  consider  you  will  be  asked  to  do  several  things. 

1 .  On  the  cover  of  each  file  is  a  place  to  indicate  the  time  you  begin  evaluating  that  case. 
Please  use  your  watch,  or  the  clock  in  the  room,  to  note  the  time  you  begin  reading  the 
case. 

2.  Read  through  each  case  carefully. 

3 .  Answer  the  following  questions  on  the  “Security  Evaluation”  form  at  the  end  of  each 
case: 

a.  Is  this  employee  eligible,  according  to  EAF,  Inc.’s  “Guidelines  for  Determining 
Eligibility  for  Access  to  Company  Sensitive  Information,”  for  promotion  to  the 
position  of  Senior  Technology  Representative? 

b.  Would  you  recommend  this  employee  for  promotion? 

c.  Please  give  specific  reasons  why  you  would  or  would  not  recommend  this 
employee  for  promotion. 

d.  What  information  presented  in  the  employee’s  security  file  was  most  important 
to  you  in  making  the  decision  to  recommend  this  employee  for  promotion? 

4.  On  the  cover  of  the  employee  file,  please  write  the  time  you  finished  the  Security 
Evaluation. 

Low  Evaluation  Expectation 

Please  note  that  the  decisions  you  make  regarding  each  employee’s  eligibility  for  access  to 
company  sensitive  information  will  submitted  directly  to  the  company  president  who  will  make  the  final 
hiring  decision. 


High  Evaluation  Expectation 

Please  note  that  the  decisions  you  make  regarding  each  employee’s  eligibility  for  access  to 
company  sensitive  information  will  be  reviewed  for  accuracy  by  the  Vice  President  of  Security  for  EAF, 


Inc.  After  the  Vice  President  reviews  each  decision,  he  will  give  his  recommendations,  and  a  review  of 
your  work,  to  the  company  president,  who  will  make  the  final  hiring  decision. 

Because  of  time  limitations,  the  Vice  President  of  Security  from  EAF,  Inc.  is  currently  on  the 
premises,  in  another  room,  ready  to  begin  evaluating  your  decisions.  Therefore,  when  you  have  completed 
Case  Packet  #1,  please  raise  your  hand.  At  this  point,  a  company  representative  will  gather  your  decided 
cases  and  deliver  them  to  the  Vice  President  for  preliminary  evaluation.  The  remaining  cases  will  be 
delivered  to  the  Vice  President  as  soon  as  you  have  completed  them. 


High-risk  condition  only 

Finally,  please  consider  that  you  are  eligible  to  receive  four  experimental  credits  for  participating 
in  this  three-hour  study.  If  it  is  obvious  to  the  researchers  in  this  study  that  you  followed  the  security 
guidelines  and  made  careful  decisions,  you  will  be  awarded  all  four  experimental  credits.  However,  if  it  is 
obvious  that  you  did  not  make  decisions  based  on  the  guidelines  provided,  you  will  be  awarded  only  three 
(out  of  four  possible)  experimental  credits  for  your  participation. 


EAF,  Inc. 


ORGANIZATIONAL  OVERVIEW 

History 

Born  in  the  early  1900s,  EAF,  Inc.  was  the  idea  of  three  men  with  strong  work  ethics  and  the  willingness 
to  risk  losing  almost  everything.  Jack  Earnest  and  Seymour  Allen  were  Texas-born  men  who  had  earned 
their  ways  in  the  rough  Pennsylvania  oil  fields.  With  dreams  of  moving  back  to  Texas  and  continuing 
their  way  in  the  oil  business,  the  men  were  given  their  chance  when  they  met  New  York  financier  Steven 
Frank. 

Frank  was  looking  to  leave  New  York  and  believed  the  Texas  oil  business  was  where  he  and  his  money 
were  needed.  However,  he  needed  the  expertise  and  knowledge  involved  in  every  aspect  of  the  oil 
business,  from  drilling  the  wells  to  refining  and  marketing  crude  oil.  This  he  found  in  Jack  Earnest  and 
Seymour  Allen.  Thus,  Earnest,  Allen,  and  Frank  (EAF),  Incorporated  Oil  Company  was  bom. 

EAF,  Inc.  was  initially  a  modest  company  that  started  out  in  1903  in  a  small  office  in  Beaumont,  Texas. 
Although  the  company  began  with  only  14  employees,  years  of  hard  work  and  considerable  effort  paid  off 
when  they  discovered  oil  in  the  small  community  of  Sweet  Creek,  Texas.  This  discovery  provided  the 
foundation  that  EAF,  Inc.  needed  to  establish  itself  as  a  major  player  in  the  Texas  oil  industry. 

Even  with  the  discovery  of  oil  in  Sweet  Creek,  the  price  of  oil  was  so  low  in  the  early  1900s  that 
excavating  and  refining  the  crude  oil  left  EAF,  Inc.  just  about  breaking  even  financially.  Smart  thinking, 
and  the  realization  that  the  newly  developed  automobile  was  about  to  become  the  biggest  consumer  of 
refined  oil  in  the  United  States,  put  EAF,  Inc.  into  the  top  rung  of  all  Texas  oil  companies,  and  would 
pave  the  path  they  would  take  for  the  next  century. 

In  the  1920s,  EAF,  Inc.  began  producing  and  marketing  a  line  of  auto  greases  for  all  vehicles,  including 
those  used  at  low  temperatures  or  high  altitudes.  During  the  1930’s  a  business  venture  with  Texas-one  Oil 
&  Gas  led  to  the  development  of  a  number  of  premium  motor  oils. 

Since  its  start  in  the  early  Twentieth  Century,  EAF,  Inc.  has  come  a  very  long  way.  From  the  most  basic 
motor  oil  and  gasoline  we  have  developed  specialized  motor  oil  and  engine  additives  for  virtually  all 
machines.  Gasoline  now  helps  to  maintain  clean  motors  and  reduce  exhaust  emissions  that  can  harm  both 
automobiles  and  the  environment. 

Along  with  product  development  have  come  considerate  gains  in  petrochemical  technology  that  has  led 
EAF,  Inc.  to  be  a  current  day  leader  in  oil  exploration,  natural  gas  gathering  and  processing,  and 
petroleum  refining,  marketing,  and  transport  throughout  the  United  States  and  North  America. 

Our  most  recent  technological  advances  have  come  in  the  form  of  chemical  and  plastics  production  and 
distribution  throughout  North  and  South  America.  Research  and  development  innovations  also  include 
seismic,  offshore  drilling,  and  environmental  improvement  technologies. 

In  2001,  EAF,  Inc.  employed  over  50,000  individuals  in  10  countries.  With  $47  billion  in  assets,  $31 
billion  in  revenues,  and  technologies  in  use  in  over  30  nations  including  Denmark,  Norway,  China, 
America,  and  Venezuela,  EAF,  Inc.  continues  to  thrive. 


Goals 

EAF,  Inc.  has  two  main  goals.  The  first  is  to  maintain  its  status  as  a  world  leader  in  energy  and 
petrochemical  technology.  By  doing  this,  we  ensure  our  second  goal,  to  achieve  superior  financial  returns 
for  all  shareholders. 

Culture 

EAF,  Inc.  is  a  global  company  meaning  we  represent  a  very  diverse  set  of  values  and  beliefs.  EAF,  Inc.  is 
devoted  to  its  employee’s  ideas  and  goals  and  works  to  encourage  all  employees  to  be  creative  and  to 
present  ideas  that  they  feel  will  make  EAF,  Inc.  a  better  place  to  work.  By  attracting  and  developing 
people  from  all  backgrounds  and  experiences,  we  hope  to  maintain  a  respect  for  all  people  regardless  of 
race,  nationality,  religion,  or  gender. 


Guideline  Driven  Judgment  Information 

One  unique  characteristic  of  EAF,  Inc.  is  the  belief  that  employees  are  best  served  when  they  are  fully 
qualified  for  a  position  upon  hiring  or  promotion.  Therefore,  it  is  not  unusual  for  EAF  to  ensure  that  an 
individual  has  all  necessary  training  and  meets  all  eligibility  requirements  before  he  or  she  is  accepted 
into  a  new  position.  In  this  way,  we  feel  that  we  help  the  individual  do  the  best  job  possible  from  the  very 
beginning. 

Developmental  Judgment  Information 

One  unique  characteristic  of  EAF,  Inc.  is  the  belief  that  employees  can  be  developed  into  their  positions 
at  EAF.  Therefore,  it  is  not  unusual  for  EAF  to  hire  or  promote  individuals  who  are  not  fully  qualified  for 
a  position,  and  to  provide  them  training  and  help  them  meet  all  requirements  for  that  position  by  working 
in  it.  In  this  way,  we  feel  that  we  help  the  individual  feel  great  ownership  in  his  or  her  job. _ 

Another  important  cultural  aspect  of  EAF,  Inc.  is  the  emphasis  placed  on  listening  and  responding  to 
customer  needs.  Our  customers  are  our  number  one  source  for  fully  understanding  the  changes  in 
society’s  expectations  and  how  we  can  best  meet  those  expectations.  Our  customers  help  to  keep  us  up-to- 
date  on  new  developments  and  new  technologies  in  companies  in  the  United  States  and  around  the  world. 

Finally,  EAF,  Inc.  is  a  member  of  the  International  Chamber  of  Commerce  and  the  World  Business 
Council  for  Sustainable  Developments  (WBCSD).  These  memberships  enable  us  to  continually  seek  and 
identify  best  practices  for  the  petrochemical  industry  and  to  learn  where  the  global  oil  industry  is  headed 
in  the  future. 


Appendix  C 

Employment  Guidelines 


GUIDELINES  FOR  DETERMINING 
ELIGIBILITY  FOR  ACCESS  TO  COMPANY 
SENSITIVE  INFORMATION 


PURPOSE 

The  following  security  evaluation  guidelines  have  been  established  for  employees  and  special  contractor 
personnel  of  EAF,  Inc.  who  require  access  to  company  sensitive  information.  They  apply  to  persons  being 
considered  for  initial  or  continued  eligibility  for  access  to  company  sensitive  information,  and  are  to  be 
used  by  the  Human  Resources  and  other  personnel  departments  and  agencies  in  specified  hiring  and 
promotion  determinations. 

SECURITY  EVALUATION  PROCESS 

The  adjudicative,  or  evaluative,  process  is  an  examination  of  a  sufficient  period  of  a  person’s  life  to  make 
an  accurate  determination  that  he  or  she  is  an  acceptable  security  risk.  Eligibility  for  access  to  company 
sensitive  information  is  dependent  upon  the  individual  meeting  these  personnel  security  guidelines.  The 
evaluation  process  is  the  careful  weighing  of  a  number  of  factors.  Work-related  and  other  security-related 
information  about  the  person,  past  and  present,  favorable  and  unfavorable,  should  be  considered  in 
reaching  a  determination.  In  evaluating  an  individual's  conduct,  the  security  specialist  should  consider  the 
following  factors: 

•  The  nature,  extent,  and  seriousness  of  the  conduct 

•  The  circumstances  surrounding  the  conduct,  to  include  knowledgeable  participation 

•  The  frequency  and  recency  of  the  conduct 

•  The  individual's  age  and  maturity  at  the  time  of  the  conduct 

•  The  voluntariness  of  participation 

•  The  presence  or  absence  of  rehabilitation  and  other  permanent  behavioral  changes 

•  The  motivation  for  the  conduct 

•  The  likelihood  that  the  individual  could  possibly  be  coerced  or  pressured  into  revealing  company 
sensitive  information 


The  likelihood  of  continuation  or  recurrence 


Each  case  must  be  judged  on  its  own  merits  and  final  determination  remains  the  responsibility  of  the 
specific  department  or  agency.  Any  doubt  concerning  personnel  being  considered  for  access  to  company 
sensitive  information  will  be  resolved  in  favor  of  the  organization’s  security  and  considered  final. 

The  ultimate  determination  of  whether  the  granting  or  continuing  of  eligibility  for  a  security  clearance  is 
clearly  consistent  with  the  interests  of  the  organization’s  security  must  be  an  overall  common  sense 
determination  based  upon  careful  consideration  of  the  following: 

A.  Personal  conduct 

B.  Alcohol  and  Drug  Involvement 

C.  Criminal  conduct 

D.  Security  violations 

E.  Outside  activities 

Each  of  the  above  should  be  evaluated  in  the  context  of  the  whole  person.  This  means  that  the  decision¬ 
maker  should  consider  behaviors  in  all  of  these  areas,  and  how  any  adverse  behaviors  have  been  corrected 
before  making  a  final  decision.  Although  adverse  information  concerning  a  single  criterion  may  not  be 
sufficient  for  an  unfavorable  determination,  the  individual  may  be  disqualified  if  available  information 
reflects  a  recent  or  recurring  pattern  of  questionable  judgment  or  irresponsibility. 

When  information  of  security  concern  becomes  known  about  an  individual  who  is  currently  eligible  for 
access  to  company  sensitive  information,  the  security  specialist  should  consider  whether  the  person: 

•  voluntarily  reported  the  information; 

•  sought  assistance  and  followed  professional  guidance,  where  appropriate; 

•  resolved  or  appears  likely  to  favorably  resolve  the  security  concern; 

•  has  demonstrated  positive  changes  in  behavior  and  employment. 

The  information  in  bold  print  at  the  beginning  of  each  security  evaluation  guideline  provides  a  brief 
explanation  of  its  relevance  in  determining  whether  it  is  clearly  consistent  with  the  interest  of  EAF,  Inc.’s 
security  to  grant  or  continue  a  person's  eligibility  for  access  to  company  sensitive  information. 


A.  PERSONAL  CONDUCT 


Conduct  involving  questionable  judgment,  untrustworthiness,  unreliability,  or  unwillingness  to 
comply  with  rules  and  regulations  could  indicate  that  the  person  may  not  properly  safeguard 
company  sensitive  information. 


The  following  will  normally  result  in  an  unfavorable  clearance  decision  or  administrative 
termination  of  further  processing  for  clearance  eligibility: 

1 )  refusal  to  undergo  or  cooperate  with  required  security  processing,  including  medical  and 
psychological  testing,  or 

2)  refusal  to  complete  required  security  forms,  releases,  or  provide  full,  frank  and  truthful  answers  to 
lawful  questions  of  security  officials  or  other  official  EAF,  Inc.  representatives  in  connection  with 
a  personnel  security  or  trustworthiness  determination. 

Conditions  that  could  raise  a  security  concern  and  may  be  disqualifying  also  include: 

1)  reliable,  unfavorable  information  provided  by  associates,  employers,  coworkers,  neighbors,  and 
other  acquaintances; 

2)  the  deliberate  omission,  concealment,  or  falsification  of  relevant  and  material  facts  from  any 
personnel  security  interview  or  any  form  used  to  determine  employment  qualifications  or  security 
clearance  eligibility  or  trustworthiness; 

3)  deliberately  providing  false  or  misleading  information  concerning  relevant  security  matters  to  a 
security  official  or  other  official  representative  in  connection  with  a  personnel  security  or 
trustworthiness  determination; 

4)  personal  conduct  or  concealment  of  information  that  increases  an  individuals  vulnerability  to 
coercion,  exploitation  or  pressure; 

5)  a  pattern  of  dishonesty  or  rule  violations; 

6)  association  with  persons  involved  in  criminal  activity. 

Conditions  that  could  mitigate  security  concerns  include: 

1)  the  information  was  not  relevant  for  a  determination  of  judgment,  trustworthiness,  or  reliability; 

2)  the  falsification  was  an  isolated  incident,  was  not  recent,  and  the  individual  has  subsequently 
provided  correct  information  voluntarily; 

3)  the  individual  made  prompt,  good-faith  efforts  to  correct  the  falsification  before  being  confronted 
with  the  facts; 

4)  omission  of  material  facts  was  caused  or  significantly  contributed  to  by  improper  or  inadequate 
advice  of  authorized  personnel,  and  -  the  previously  omitted  information  was  promptly  and  fully 
provided; 


5)  the  individual  has  taken  positive  steps  to  significantly  reduce  or  eliminate  vulnerability  to 
coercion,  exploitation,  or  pressure; 

6)  a  refusal  to  cooperate  was  based  on  advice  from  legal  counsel  or  other  officials  that  the  individual 
was  not  required  to  comply  with  security  processing  requirements  and,  upon  being  made  aware  of 
the  requirement,  fully  and  truthfully  provided  the  requested  information; 

7)  association  with  persons  involved  in  criminal  activities  has  ceased. 


B.  ALCOHOL  CONSUMPTION  AND  DRUG  INVOLVEMENT 

Excessive  drug  or  alcohol  consumption  often  leads  to  the  exercise  of  questionable  judgment, 
unreliability,  failure  to  control  impulses,  and  increases  the  risk  of  unauthorized  disclosure  of 
company  sensitive  information  due  to  carelessness.  Improper  or  illegal  involvement  with  drugs 
raises  questions  regarding  an  individual's  willingness  or  ability  to  protect  company  sensitive 
information.  Drug  abuse  or  dependence  may  impair  social  or  occupational  functioning,  increasing 
the  risk  of  an  unauthorized  disclosure  of  company  sensitive  information. 


Conditions  that  could  raise  a  security  concern  and  may  be  disqualifying  include: 

1 )  alcohol-related  incidents  away  from  work,  such  as  driving  while  under  the  influence,  fighting, 
child  or  spouse  abuse,  or  other  criminal  incidents  related  to  alcohol  use; 

2)  alcohol-related  incidents  at  work,  such  as  reporting  for  work  or  duty  in  an  intoxicated  or  impaired 
condition,  or  drinking  on  the  job; 

3)  diagnosis  by  a  credentialed  medical  professional  of  alcohol  abuse  or  alcohol  dependence; 

4)  habitual  or  binge  consumption  of  alcohol  to  the  point  of  impaired  judgment; 

5)  consumption  of  alcohol  or  drugs  following  completion  of  an  alcohol  or  drug  rehabilitation 
program; 

6)  any  drug  abuse  (drug  abuse  is  the  illegal  use  of  a  drug  or  use  of  a  legal  drug  in  a  manner  that 
deviates  from  approved  medical  direction); 

7)  illegal  drug  possession,  including  cultivation,  processing,  manufacture,  purchase,  sale,  or 
distribution; 

8)  failure  to  successfully  complete  a  drug  treatment  program  prescribed  by  a  credentialed  medical 
professional. 

(Current  drug  involvement  with  an  expressed  intent  not  to  discontinue  use,  will  normally  result  in  an 

unfavorable  determination.) 

Conditions  that  could  mitigate  security  concerns  include: 

1)  the  alcohol  related  incidents  do  not  indicate  a  pattern; 


2)  the  problem  occurred  a  number  of  years  ago  and  there  is  no  indication  of  a  recent  problem; 

3)  positive  changes  in  behavior  supportive  of  sobriety; 

4)  following  diagnosis  of  alcohol  abuse  or  alcohol  dependence,  the  individual  has  successfully 
completed  inpatient  or  outpatient  rehabilitation  along  with  aftercare  requirements,  participates 
frequently  in  meetings  of  Alcoholics  Anonymous  or  a  similar  organization,  abstained  from 
alcohol  for  a  period  of  at  least  12  months,  and  received  a  favorable  prognoses  by  a  credentialed 
medical  professional; 

5)  the  drug  involvement  was  not  recent; 

6)  the  drug  involvement  was  an  isolated  or  infrequent  event; 

7)  a  demonstrated  intent  not  to  abuse  any  drugs  in  the  future; 

8)  satisfactoiy  completion  of  a  drug  treatment  program  prescribed  by  a  credentialed  medical 
professional. 


C.  CRIMINAL  CONDUCT 

A  history  or  pattern  of  criminal  activity  creates  doubt  about  a  person's  judgment,  reliability  and 
trustworthiness. 


Conditions  that  could  raise  a  security  concern  and  may  be  disqualifying  include: 

1)  any  criminal  conduct,  regardless  of  whether  the  person  was  formally  charged; 

2)  a  single  serious  crime  or  multiple  lesser  offenses. 

Conditions  that  could  mitigate  security  concerns  include: 

1 )  the  criminal  behavior  was  not  recent; 

2)  the  crime  was  an  isolated  incident; 

3)  the  person  was  pressured  or  coerced  into  committing  the  act  and  those  pressures  are  no  longer 
present  in  that  person's  life; 

4)  the  person  did  not  voluntarily  commit  the  act  and/or  the  factors  leading  to  the  violation  are  not 
likely  to  recur; 

5)  there  is  clear  evidence  of  successful  rehabilitation. 


D.  SECURITY  VIOLATIONS 


Noncompliance  with  security  regulations  raises  doubt  about  an  individual's  trustworthiness, 
willingness,  and  ability  to  safeguard  company  sensitive  information. 


Conditions  that  could  raise  a  security  concern  and  may  be  disqualifying  include: 

1)  unauthorized  disclosure  of  company  sensitive  information; 

2)  violations  that  are  deliberate  or  multiple  or  due  to  negligence. 

Conditions  that  could  mitigate  security  concerns  include  actions  that: 

1)  were  inadvertent; 

2)  were  isolated  or  infrequent; 

3)  were  due  to  improper  or  inadequate  training; 

4)  demonstrate  a  positive  attitude  towards  the  discharge  of  security  responsibilities. 


E.  OUTSIDE  ACTIVITIES 

Involvement  in  certain  types  of  outside  employment  or  activities  is  of  security  concern  if  it  poses  a 
conflict  with  an  individual's  security  responsibilities  and  could  create  an  increased  risk  of 
unauthorized  disclosure  of  company  sensitive  information. 


Conditions  that  could  raise  a  security  concern  and  may  be  disqualifying  include: 

Any  service,  whether  compensated,  volunteer,  or  employment  with: 

1)  a  competing  company; 

2)  any  representative  from  a  competing  company; 

Conditions  that  could  mitigate  security  concerns  include: 

1)  evaluation  of  the  outside  employment  or  activity  indicates  that  it  does  not  pose  a  conflict  with  an 
individual's  security  responsibilities; 

2)  the  individual  terminates  the  employment  or  discontinues  the  activity  upon  being  notified  that  it  is 
in  conflict  with  his  or  her  security  responsibilities. 


